-- Logs begin at Mon 2022-10-10 16:18:22 UTC, end at Mon 2022-10-10 17:33:33 UTC. -- Oct 10 16:59:09.926685 dv-cinder-834540-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 16:59:09.935414 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 16:59:09 2022] *** Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: nodename: dv-cinder-834540-2-iscsi Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: machine: x86_64 Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: clock source: unix Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: pcre jit disabled Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: detected number of CPU cores: 4 Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: current working directory: / Oct 10 16:59:09.937736 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: detected binary path: /usr/bin/uwsgi-core Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: your processes number limit is 47680 Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: your memory page size is 4096 bytes Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: detected max file descriptor number: 2048 Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: lock engine: pthread robust mutexes Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: thunder lock: enabled Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 16:59:09.938545 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 16:59:09.976885 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: Python main interpreter initialized at 0x558d6084f9c0 Oct 10 16:59:09.976885 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: python threads support enabled Oct 10 16:59:09.976885 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: your server socket listen backlog is limited to 100 connections Oct 10 16:59:09.976885 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: your mercy for graceful operations on workers is 90 seconds Oct 10 16:59:09.977208 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 16:59:09.977286 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: *** Operational MODE: preforking *** Oct 10 16:59:09.977533 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: *** uWSGI is running in multiple interpreter mode *** Oct 10 16:59:09.977533 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: spawned uWSGI master process (pid: 104215) Oct 10 16:59:09.977733 dv-cinder-834540-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 16:59:09.985721 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: spawned uWSGI worker 1 (pid: 104216, cores: 1) Oct 10 16:59:09.985721 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: spawned uWSGI worker 2 (pid: 104217, cores: 1) Oct 10 16:59:09.985721 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 16:59:10.635472 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 16:59:10.642673 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 16:59:11.716614 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:59:11.716614 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: from cryptography.utils import int_from_bytes Oct 10 16:59:11.717314 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:59:11.717314 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: from cryptography.utils import int_from_bytes Oct 10 16:59:11.717663 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:59:11.717663 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: from cryptography.utils import int_from_bytes Oct 10 16:59:11.718126 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:59:11.718126 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: from cryptography.utils import int_from_bytes Oct 10 16:59:14.184971 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 16:59:14.185598 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 16:59:14.185950 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 16:59:14.186046 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 16:59:14.186129 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 16:59:14.186207 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 16:59:14.186284 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 16:59:14.186363 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 16:59:14.186440 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 16:59:14.186533 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 16:59:14.186950 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187094 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187275 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187388 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187593 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187699 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.187913 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188012 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188274 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188382 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188587 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188701 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188901 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.188987 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189214 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189315 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189535 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189625 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189819 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.189907 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190131 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190223 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190450 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834540-2-iscsi {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190538 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834540-2-iscsi {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190767 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.190854 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191068 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191171 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191374 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191467 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191686 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191777 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.191982 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.192109 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.192324 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.192416 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.192624 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.192720 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193116 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193225 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193546 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193646 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193847 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.193945 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194150 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194241 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194481 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194571 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194788 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.194879 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.195090 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.195275 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.195491 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.195666 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.195858 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196077 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196258 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196438 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196622 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196815 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.196996 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834540-2-iscsi {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.197208 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834540-2-iscsi {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.197419 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.197571 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.197794 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.197951 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.198130 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.198345 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.198548 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.198754 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.198945 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199110 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199269 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199394 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199545 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199670 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199794 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.199961 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200111 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200247 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200373 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200503 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200657 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200791 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.200917 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201049 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201188 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201312 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201445 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201570 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201694 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201819 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.201965 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202090 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202223 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202351 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202483 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202607 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202732 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202856 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.202993 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203199 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203336 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203461 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203592 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203723 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203865 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.203991 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204144 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204273 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204400 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204578 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204733 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204865 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.204999 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.205125 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.205258 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.205888 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206022 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206146 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206271 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206394 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206599 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206737 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206863 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.206995 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207119 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207243 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207376 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207507 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207639 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207762 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.207886 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208040 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208180 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208313 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208438 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208562 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208743 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.208881 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209047 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209177 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209363 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209500 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209754 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.209890 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210023 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210147 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210271 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210395 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210610 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210751 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.210925 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211062 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211229 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211361 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211541 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211675 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211856 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.211989 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212183 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212311 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212482 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212609 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212781 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.212908 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213096 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213310 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213448 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213574 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213716 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213852 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.213977 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214099 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214232 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214358 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214527 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214663 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214837 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.214972 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215137 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215264 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215435 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215568 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215733 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.215868 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216043 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216184 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216347 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216482 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216647 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216782 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.216945 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217070 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217243 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217370 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217544 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217841 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.217975 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218138 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218264 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218444 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218584 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218742 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.218869 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219039 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219172 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219351 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219489 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219665 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219793 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.219967 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220118 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220294 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220424 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220594 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220736 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.220916 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.221580 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.221775 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.221913 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222083 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222212 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222384 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222513 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222703 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.222845 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223005 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223356 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223634 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223762 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.223908 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224095 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224235 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224368 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224538 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224675 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224836 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.224963 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225138 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225272 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225454 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225581 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225755 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.225883 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226056 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226182 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226357 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226492 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226656 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226783 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.226953 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227089 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227253 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227380 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227551 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227679 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227847 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.227984 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228151 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228271 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228472 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228600 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228786 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.228926 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229088 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229214 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229386 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229513 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229686 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229821 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.229999 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.230127 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:59:14.230326 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.230452 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.230653 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.230781 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.230992 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231121 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231301 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231427 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231627 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231755 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.231954 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232122 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232295 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232423 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232603 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232731 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.232913 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233040 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233234 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233454 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233650 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233777 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.233901 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234025 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234149 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234283 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234431 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234580 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234744 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.234872 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235071 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235198 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235386 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235520 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235697 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.235825 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236010 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236173 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236339 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236476 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.236806 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237004 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237139 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237321 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237457 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237627 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237753 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.237962 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238098 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238304 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238438 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238617 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238758 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.238937 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239072 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239254 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239382 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239564 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239690 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239868 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.239996 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240198 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240335 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240537 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240666 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240845 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.240972 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241151 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241285 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241464 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241599 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241773 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.241901 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242090 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242216 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242397 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242524 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242702 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.242829 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243010 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243146 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243315 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243454 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243696 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243834 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.243967 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244146 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244275 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244417 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244583 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244718 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.244894 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245030 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245201 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245343 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245513 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245640 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245818 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.245948 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246124 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246260 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246429 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246555 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246728 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.246855 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247027 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247163 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247327 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247454 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247630 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247756 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.247929 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248102 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248269 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248395 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248593 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248731 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.248893 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249022 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249221 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249347 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249521 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249654 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249826 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.249955 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250130 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250257 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250434 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250560 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250732 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.250861 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251037 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251164 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251344 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251480 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251644 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251771 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.251961 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.252119 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.252823 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.252959 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253126 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253253 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253441 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253568 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253811 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.253958 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254085 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254217 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254343 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254466 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254638 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254776 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.254944 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255071 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255251 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255380 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255556 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255685 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.255874 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256001 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256192 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256360 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256568 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256696 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256826 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.256952 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257128 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257257 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257429 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257568 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257747 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.257873 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258065 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258201 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258374 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258493 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258674 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258803 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.258984 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259124 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259286 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259412 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259587 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259721 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.259888 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260047 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260218 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260345 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260516 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260651 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260815 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.260951 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261113 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261248 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261412 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261541 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261710 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.261855 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262026 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262153 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262329 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262466 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262627 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262754 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.262925 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263053 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263220 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263347 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263558 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263693 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.263928 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264096 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264225 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264348 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264534 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264673 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264848 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.264974 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265166 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265300 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265472 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265592 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265781 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.265922 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266085 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266221 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266390 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266517 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266693 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266822 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.266998 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.267134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.267309 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.267443 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.267613 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.267740 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.268485 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.268616 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.268802 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.268934 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269121 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269250 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269427 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269562 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269739 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.269874 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270038 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270165 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270347 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270488 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270680 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.270806 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271006 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271140 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271317 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271445 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271633 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271760 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.271939 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272080 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272274 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272405 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272582 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272712 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.272889 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273019 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273195 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273325 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273500 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273627 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273813 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.273947 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274165 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274293 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274418 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274541 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274704 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.274841 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275146 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275323 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275448 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275635 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275775 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.275933 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276094 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276264 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276392 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276584 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276722 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.276913 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277040 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277218 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277345 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277524 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277663 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277837 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.277964 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278139 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278267 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278443 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278572 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278746 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.278879 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279051 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279178 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279349 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279477 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279650 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279777 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.279958 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280110 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280287 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280426 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280590 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280717 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.280889 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281015 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281196 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281324 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281501 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281628 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281799 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.281935 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282096 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282224 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282399 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282529 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282715 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.282853 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283019 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283145 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283342 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283469 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283684 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283792 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.283986 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284103 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284311 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284406 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284629 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284729 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.284932 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285017 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285231 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285314 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285529 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285622 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285830 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.285926 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286164 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286260 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286469 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286554 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286768 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.286852 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287078 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287176 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287393 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287486 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287697 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.287797 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288008 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288119 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288335 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288422 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288648 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288735 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.288962 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289064 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289268 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289353 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289587 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289746 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.289903 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290062 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290201 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290338 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290484 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290621 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290758 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.290904 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291050 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291193 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291337 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291474 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291645 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291800 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.291956 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292146 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292286 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292421 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292570 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292709 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292845 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.292982 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.293410 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.293557 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.293737 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.293882 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294046 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294203 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294428 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294572 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294720 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.294866 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295019 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295175 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295314 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295451 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295589 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295726 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.295897 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296089 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296237 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296386 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296524 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296661 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296807 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.296946 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297084 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297230 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297368 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297505 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297650 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297787 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.297935 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298079 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298242 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298395 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298543 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298681 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.298855 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299003 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299141 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299278 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299428 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299567 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299733 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.299890 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300059 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300222 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300362 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300499 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300636 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300772 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.300909 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301055 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301233 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301379 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301539 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301683 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301832 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.301977 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302115 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302252 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302389 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302533 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302729 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.302883 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303023 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303165 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303350 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303654 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303791 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.303997 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.304164 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.304325 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.304552 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.304711 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.304856 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305001 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305138 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305283 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305419 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305566 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305721 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.305867 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306005 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306142 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306286 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306424 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306561 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306698 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306835 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.306984 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307130 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307267 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307403 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307550 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307696 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307841 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.307986 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308181 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308321 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308458 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308594 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308738 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.308951 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309099 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309248 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309397 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309534 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309680 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309819 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.309955 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310092 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310228 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310364 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310509 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310646 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310783 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.310920 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.311056 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.311201 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.311351 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.311496 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.311886 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312048 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312193 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312329 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312482 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312620 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312757 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.312894 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313029 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313174 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313322 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313460 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313732 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.313900 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.314055 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.314194 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.314330 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.314493 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315202 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315333 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315469 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315602 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315728 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.315887 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316017 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316212 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316359 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316515 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316642 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316833 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.316960 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317141 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317269 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317439 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317567 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317741 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.317867 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318039 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318336 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318463 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318632 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318759 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.318932 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319051 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319229 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319357 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319529 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319656 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319825 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.319945 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320145 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320275 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320444 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320580 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320759 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.320886 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321062 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321196 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321362 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321498 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321660 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321795 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.321955 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322082 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322290 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322428 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322591 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322718 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.322938 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323066 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323236 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323376 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323545 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323673 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323857 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.323984 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324180 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324306 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324479 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324609 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324788 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.324898 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325085 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325180 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325393 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325486 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325697 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.325791 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326002 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326095 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326296 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326420 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326594 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326871 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.326980 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327197 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327298 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327498 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327591 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327808 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.327911 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328144 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328238 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328464 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328549 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328766 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.328856 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329074 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329216 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329381 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329509 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329681 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329810 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.329985 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.330112 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.330305 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.330931 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331137 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331266 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331449 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331578 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331760 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.331898 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332090 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332220 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332401 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332528 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332701 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.332842 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333000 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333128 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333305 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333443 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333607 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333750 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.333907 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334041 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334223 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334349 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334525 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334661 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.334826 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335035 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335164 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335288 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335412 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335550 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335706 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.335835 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336004 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336161 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336576 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336753 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.336878 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337055 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337183 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337355 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337490 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337661 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337787 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.337965 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338092 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338296 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338422 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338553 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338678 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338862 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.338989 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.339251 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.339378 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.339566 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.339701 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.339871 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340006 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340196 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340335 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340623 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340799 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.340940 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341108 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341238 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341408 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341535 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341709 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.341847 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342010 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342136 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342311 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342447 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342748 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.342917 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343051 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343235 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343365 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343618 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343747 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.343919 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344084 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344336 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344476 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344654 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344782 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.344960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345166 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345316 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345459 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345593 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345720 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.345878 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346016 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346202 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346330 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346513 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346641 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346818 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.346946 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347122 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347249 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347441 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347571 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347744 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.347873 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348074 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348207 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348378 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348593 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348723 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348847 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.348973 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349099 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349295 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349438 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349606 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349737 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.349926 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350062 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350318 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350455 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350625 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350756 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.350935 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351070 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351252 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351395 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351554 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351682 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351858 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.351986 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352182 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352312 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352484 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352620 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352784 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.352912 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353084 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353222 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353394 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353521 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353692 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353821 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.353999 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354127 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354302 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354429 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354601 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354728 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.354896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355022 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355229 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355394 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355528 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355666 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355799 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.355931 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356110 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356242 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356424 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356571 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356739 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.356866 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357041 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357169 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357342 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357494 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357747 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.357875 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358002 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358136 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358262 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358396 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358530 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358664 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358813 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.358942 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359129 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359258 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359449 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359577 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359767 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.359897 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360110 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360242 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360423 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360552 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360731 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.360858 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361062 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361191 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361379 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361515 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361720 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.361849 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362026 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362166 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362340 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362470 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362638 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362775 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.362938 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363068 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363238 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363367 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363536 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363674 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363836 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.363964 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364157 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364285 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364448 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364590 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364747 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.364877 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365045 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365172 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365346 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365474 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365646 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365751 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.365954 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366060 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366256 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366356 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366561 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366667 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366862 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.366962 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367161 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367255 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367456 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367550 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367754 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.367847 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368105 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368202 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368429 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368516 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368733 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.368819 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369052 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369140 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369366 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369468 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369679 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369790 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.369986 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370071 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370296 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370403 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370609 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370715 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370914 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.370999 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371224 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371310 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371530 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371625 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371837 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.371939 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372167 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372272 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372479 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372572 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372793 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.372993 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.373309 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.373395 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.373617 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.373702 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.373924 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374009 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374231 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374316 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374539 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374625 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374845 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.374930 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375153 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375239 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375459 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375545 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375761 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.375853 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376086 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376189 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376420 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376506 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376747 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.376832 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.377084 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.377760 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.377927 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378021 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378240 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378324 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378554 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378649 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378866 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.378953 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379178 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379263 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379493 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379593 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379833 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.379930 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380157 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380259 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380474 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380561 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380785 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.380874 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381095 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381194 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381403 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381487 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381709 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.381793 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382016 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382114 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382325 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382410 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382632 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382716 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.382939 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383033 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383247 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383330 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383555 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383651 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383867 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.383961 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384216 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384307 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384529 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384613 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384842 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.384930 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385151 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385459 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385543 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385769 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.385979 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.386287 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.386388 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.386598 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.386695 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.386928 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387020 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387249 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387333 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387563 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387658 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387895 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.387988 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388213 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388317 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388516 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388610 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388819 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.388905 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389119 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389203 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389425 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389522 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389728 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.389843 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390029 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390126 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390345 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390432 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390644 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390729 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.390942 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.391029 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.391253 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.391340 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.391557 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.391780 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.392107 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.392198 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.392451 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.392540 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.392782 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.393443 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.393621 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.393706 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.393937 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394011 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394242 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394316 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394543 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394624 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.394865 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.395035 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.395168 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.395345 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.395463 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.395770 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.396108 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.396412 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.396714 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.396788 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.397021 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.397327 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.397627 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.397933 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.398235 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.398558 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.398645 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.398860 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.398942 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.399162 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.399462 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.399773 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.400103 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.400409 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.400510 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.400713 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.400811 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401015 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401121 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401322 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401417 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401623 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401720 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.401926 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402035 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402226 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402327 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402531 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402633 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402881 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.402982 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403187 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403288 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403488 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403581 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403808 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.403902 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404141 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404235 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404445 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404538 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404751 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.404851 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405056 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405148 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405360 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405451 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405672 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.405821 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406064 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406211 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406343 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406430 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406617 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.406816 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407066 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407212 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407375 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407535 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407691 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407830 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.407997 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.408196 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.408439 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.408600 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.408742 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.408892 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409031 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409169 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409314 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409556 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409716 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409856 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.409995 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410132 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410280 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410428 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410574 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410723 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.410862 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411035 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411197 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411377 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411525 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411703 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.411857 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412039 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412213 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412358 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412498 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412637 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412786 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.412932 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413081 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413219 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413357 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413494 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413634 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413781 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.413921 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414096 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414244 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414432 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414588 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414738 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.414877 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415048 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415195 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415341 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415481 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415656 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415804 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.415950 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416117 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416281 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416445 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416595 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416742 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.416881 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417019 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417166 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417315 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417481 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417626 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417769 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.417906 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.418076 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.418235 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.418404 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.418718 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.418867 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419034 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419191 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419331 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419476 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419652 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419804 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.419945 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420137 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420292 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420444 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420590 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420728 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.420867 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421015 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421161 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421300 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421484 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421634 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421782 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.421921 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.422089 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.422235 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.422447 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.422767 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.422924 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423066 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423203 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423341 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423479 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423646 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423806 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.423953 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424161 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424310 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424460 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424608 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424747 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.424885 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425022 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425161 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425299 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425445 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425591 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425730 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.425876 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426023 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426204 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426373 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426536 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426682 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.426864 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427157 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427305 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427444 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427582 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427747 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.427891 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428121 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428311 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428456 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428611 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428825 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.428969 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429117 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429257 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429396 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429534 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429672 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429810 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.429957 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430106 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430256 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430396 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430534 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430671 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430818 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.430958 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431096 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431232 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431378 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431527 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431666 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431804 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.431955 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432138 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432291 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432440 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432581 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432717 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.432866 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433004 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433141 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433288 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433427 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433566 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433704 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.433850 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434010 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434163 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434303 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434441 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434579 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434717 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.434868 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435056 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435204 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435342 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435479 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435617 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435779 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.435931 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.436110 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.436272 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.436419 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.436562 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.436970 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437117 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437260 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437403 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437546 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437768 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.437917 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438072 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438216 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438359 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438502 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438655 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.438821 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.439041 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.439192 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.439336 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.439480 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440170 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440342 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440499 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440644 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440788 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.440940 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441094 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441239 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441383 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441534 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441685 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441840 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.441985 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442129 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442282 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442426 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442570 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442723 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.442867 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443013 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443156 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443309 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443452 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443604 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443750 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.443893 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444071 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444236 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444429 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444581 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444724 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.444868 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445012 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445155 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445308 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445453 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445603 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445748 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.445892 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.446057 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.446212 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.446358 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.446503 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 16:59:14.446648 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.446792 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.447036 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.447344 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.447683 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.448008 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.448373 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.448684 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.449097 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.449351 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.449661 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.449972 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.450275 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:59:14.450517 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 16:59:14.598671 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO dbcounter [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Registered counter for database nova_api Oct 10 16:59:14.607385 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO dbcounter [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Registered counter for database nova_api Oct 10 16:59:14.619179 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_db.sqlalchemy.engines [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.625854 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writer thread running {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.629228 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_db.sqlalchemy.engines [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.635603 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writer thread running {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.682419 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.context [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faa300-58d0-4d9b-bfd7-9b3182920878(cell1) {{(pid=104217) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 16:59:14.686370 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 16:59:14.687055 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 16:59:14.688619 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 16:59:14.689343 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 16:59:14.689816 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 16:59:14.691774 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 16:59:14.692441 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.context [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faa300-58d0-4d9b-bfd7-9b3182920878(cell1) {{(pid=104216) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 16:59:14.693775 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO dbcounter [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Registered counter for database nova_cell0 Oct 10 16:59:14.696252 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 16:59:14.696725 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 16:59:14.697759 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO dbcounter [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Registered counter for database nova_cell1 Oct 10 16:59:14.698266 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 16:59:14.698990 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 16:59:14.699432 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 16:59:14.701437 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_concurrency.lockutils [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 16:59:14.703450 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO dbcounter [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Registered counter for database nova_cell0 Oct 10 16:59:14.705184 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_db.sqlalchemy.engines [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.708230 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO dbcounter [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Registered counter for database nova_cell1 Oct 10 16:59:14.708349 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_db.sqlalchemy.engines [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.712483 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writer thread running {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.715270 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_db.sqlalchemy.engines [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.716906 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_db.sqlalchemy.engines [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.718180 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writer thread running {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.723532 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writer thread running {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.725016 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writer thread running {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.859082 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO dbcounter [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Registered counter for database nova_cell0 Oct 10 16:59:14.868308 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_db.sqlalchemy.engines [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.870700 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO dbcounter [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Registered counter for database nova_cell0 Oct 10 16:59:14.873358 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writer thread running {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:14.879325 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG oslo_db.sqlalchemy.engines [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:59:14.883941 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writer thread running {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:59:15.277072 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: WARNING keystonemiddleware.auth_token [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 16:59:15.285069 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: WARNING keystonemiddleware.auth_token [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 16:59:15.307602 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: WARNING keystonemiddleware.auth_token [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 16:59:15.315216 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: WARNING keystonemiddleware.auth_token [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 16:59:15.626575 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: WARNING keystonemiddleware.auth_token [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 16:59:15.633127 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: WARNING keystonemiddleware.auth_token [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 16:59:15.638746 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d6084f9c0 pid: 104217 (default app) Oct 10 16:59:15.640845 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 16:59:15.642041 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Oct 10 16:59:15.642446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Oct 10 16:59:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 16:59:15.654314 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: WARNING keystonemiddleware.auth_token [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 16:59:15.660297 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: WARNING keystonemiddleware.auth_token [None req-ab88f699-7e1b-4ecc-a947-71b14240540c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 16:59:15.665543 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d6084f9c0 pid: 104216 (default app) Oct 10 17:00:38.980808 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:38.981828 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 10 17:00:38.982230 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:00:38.995189 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_api:SELECT=3 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:38.996468 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_cell1:SELECT=3 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:38.997597 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_cell0:SELECT=3 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:38.999675 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:39.840298 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-1e33baf6-0646-42a2-a3f7-2d8916e955ce admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:39.879164 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-1e33baf6-0646-42a2-a3f7-2d8916e955ce admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.889225 Oct 10 17:00:39.880008 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 10 17:00:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:00:42.533202 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:42.534270 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-e49efa6b-8ae0-4402-a44b-eaa60bf31343 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 10 17:00:42.534830 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:00:42.986145 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-d05f7ecd-c0a0-4d09-8fb2-5d4eea5d91d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:43.096890 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-d05f7ecd-c0a0-4d09-8fb2-5d4eea5d91d2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.556012 Oct 10 17:00:43.097469 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:00:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 17:00:43.111262 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_api:SELECT=3 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:43.111991 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_cell0:SELECT=3 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:43.114042 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_cell1:SELECT=3 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:43.114947 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:43.319388 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-8e5bc487-d65e-4c39-a817-090d27238dfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:43.442699 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-8e5bc487-d65e-4c39-a817-090d27238dfe admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.336733 Oct 10 17:00:43.443290 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 10 17:00:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:00:46.044553 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-d05f7ecd-c0a0-4d09-8fb2-5d4eea5d91d2 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:46.045732 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-d05f7ecd-c0a0-4d09-8fb2-5d4eea5d91d2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Oct 10 17:00:46.046359 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:00:46.700991 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-15419d64-7c85-4d2d-b54a-196f20d8974c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 5, "ram": 512}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:46.867169 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-15419d64-7c85-4d2d-b54a-196f20d8974c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.814041 Oct 10 17:00:46.868253 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:00:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:00:46.883593 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-5a94e015-ff80-431e-839c-d330f26625b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:47.010070 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-5a94e015-ff80-431e-839c-d330f26625b2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132386 Oct 10 17:00:47.010740 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 10 17:00:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:00:49.613598 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-15419d64-7c85-4d2d-b54a-196f20d8974c admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:49.614611 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-15419d64-7c85-4d2d-b54a-196f20d8974c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 10 17:00:49.615013 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:00:50.029657 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-533482d3-bce4-4715-81ac-5e5173ba551b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:50.113934 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-533482d3-bce4-4715-81ac-5e5173ba551b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492825 Oct 10 17:00:50.114442 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:00:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:00:50.127409 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-4fe25ca7-087d-4dc9-a724-d12b5e8fba8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:50.217803 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-4fe25ca7-087d-4dc9-a724-d12b5e8fba8a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093038 Oct 10 17:00:50.217803 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 10 17:00:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:00:52.836936 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-533482d3-bce4-4715-81ac-5e5173ba551b admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:52.837939 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-533482d3-bce4-4715-81ac-5e5173ba551b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 10 17:00:52.838334 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:00:53.262674 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-02730047-10f2-463a-adfb-84893418828f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:53.342225 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-02730047-10f2-463a-adfb-84893418828f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497762 Oct 10 17:00:53.342858 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:00:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:00:53.355570 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-8a46b10b-727f-46e8-9ab7-6cf8883e231a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:53.454777 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-8a46b10b-727f-46e8-9ab7-6cf8883e231a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103042 Oct 10 17:00:53.455621 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 10 17:00:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:00:56.111577 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-02730047-10f2-463a-adfb-84893418828f admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:56.112883 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-02730047-10f2-463a-adfb-84893418828f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Oct 10 17:00:56.113422 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:00:56.557473 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:56.640088 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518990 Oct 10 17:00:56.640649 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:00:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:00:56.654389 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-263d7902-a7ed-47cf-ace5-cdd4e2f25f45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:00:56.753075 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-263d7902-a7ed-47cf-ace5-cdd4e2f25f45 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103391 Oct 10 17:00:56.753738 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 10 17:00:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:00:59.583234 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:00:59.584390 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Oct 10 17:00:59.585109 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:01:00.016073 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-9975dcfe-f7f8-4847-ae35-6531a37bbc7d admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:00.046161 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-9975dcfe-f7f8-4847-ae35-6531a37bbc7d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453940 Oct 10 17:01:00.047586 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 10 17:00:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:01:02.670548 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:02.671568 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-6503cc9d-b750-4860-bfe3-c0bc2e18eb8f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 10 17:01:02.672622 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:03.065052 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f5cc2415-1df0-4053-94e4-223d726ccc93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:03.142476 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f5cc2415-1df0-4053-94e4-223d726ccc93 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.464033 Oct 10 17:01:03.143096 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:01:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:03.155160 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-7d3cce9d-5309-437c-bbbc-17937c6e338e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:03.237113 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-7d3cce9d-5309-437c-bbbc-17937c6e338e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085589 Oct 10 17:01:03.237703 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 10 17:01:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:01:05.793224 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f5cc2415-1df0-4053-94e4-223d726ccc93 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:05.794174 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f5cc2415-1df0-4053-94e4-223d726ccc93 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 10 17:01:05.794568 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:06.186309 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bdf6c277-c490-4e37-9f44-8decd78544ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:06.252500 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bdf6c277-c490-4e37-9f44-8decd78544ee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451042 Oct 10 17:01:06.253820 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:01:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 17:01:06.265439 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-42d0c281-16a0-4bb0-8f58-6a6bc5b9d568 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:06.909870 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-42d0c281-16a0-4bb0-8f58-6a6bc5b9d568 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.648185 Oct 10 17:01:06.910605 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 10 17:01:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:01:09.577557 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bdf6c277-c490-4e37-9f44-8decd78544ee admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:09.579136 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bdf6c277-c490-4e37-9f44-8decd78544ee admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Oct 10 17:01:09.579810 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:10.036968 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-6c60c839-3b01-4f13-adeb-85a5a459f6f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "swap": 0, "ram": 4096}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:10.142864 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-6c60c839-3b01-4f13-adeb-85a5a459f6f5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.557082 Oct 10 17:01:10.143506 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:01:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:10.155617 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-014d1666-31a5-414c-bd7d-628308468717 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:10.161168 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:10.237914 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-014d1666-31a5-414c-bd7d-628308468717 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085880 Oct 10 17:01:10.238777 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 10 17:01:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:01:12.880364 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-6c60c839-3b01-4f13-adeb-85a5a459f6f5 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:12.881364 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-6c60c839-3b01-4f13-adeb-85a5a459f6f5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 10 17:01:12.886672 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:13.319776 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-012022ba-ef47-4c94-983e-10feeeaf71c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:13.394580 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-012022ba-ef47-4c94-983e-10feeeaf71c5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506225 Oct 10 17:01:13.395304 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:01:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:13.407802 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-b787a975-5d53-4563-87d9-5d2f8b5a9c62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:13.535050 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-b787a975-5d53-4563-87d9-5d2f8b5a9c62 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131315 Oct 10 17:01:13.535787 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 10 17:01:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:01:16.152716 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-012022ba-ef47-4c94-983e-10feeeaf71c5 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:16.153645 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-012022ba-ef47-4c94-983e-10feeeaf71c5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 10 17:01:16.154315 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:16.582097 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:16.588166 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:16.664110 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.503103 Oct 10 17:01:16.664815 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 10 17:01:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:16.677239 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-b34beb04-fac4-4d3e-b160-35644047e4d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:16.740792 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-b34beb04-fac4-4d3e-b160-35644047e4d1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067051 Oct 10 17:01:16.741730 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 10 17:01:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:01:32.986328 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:32.987329 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 10 17:01:32.987730 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:32.998095 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:33.378180 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-0fa9de6c-8136-4e84-8ceb-2efd1056e6e4 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:33.396731 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-0fa9de6c-8136-4e84-8ceb-2efd1056e6e4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403081 Oct 10 17:01:33.397198 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 10 17:01:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:01:34.687438 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:34.688764 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-c90230a6-2a67-413e-8ec2-11e9fc6646a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 10 17:01:34.689157 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:35.205837 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-130a688d-2638-4bf7-b37c-773e5f20d0a4 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:35.211508 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.wsgi [None req-130a688d-2638-4bf7-b37c-773e5f20d0a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-130a688d-2638-4bf7-b37c-773e5f20d0a4 admin admin] Request method failure captured: Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept: application/json Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept-Encoding: gzip, deflate Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Connection: keep-alive Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Content-Length: 0 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Host: 10.222.0.42 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-System-Scope: None Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: User-Agent: python-novaclient Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Auth-Token: gAAAAABjRE_ui9vcaRbgEhhAEeeNuh5vLulWPgyJ-bbt5yfqol7j39-m0PlRnQIxrOCUAZLM4qa-PM65HkCrnStwyS9z-8VXUMmeCb5I32gHuIu6Zy-DfcjpuSP3r1q4n0_ddllMteTa-9fg7jSLMalpAEyhAQiTyrfDeN8b5KMnDS18NEcDOqQ Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Id: None Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Name: None Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Identity-Status: Confirmed Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Is-Admin-Project: True Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Id: default Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Name: Default Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Name: admin Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Role: reader,member,admin Oct 10 17:01:35.214849 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Roles: reader,member,admin Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant: admin Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Name: admin Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User: admin Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Id: default Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Name: Default Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Name: admin Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: method: > Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: exception: Flavor 42 could not be found. Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: action_args: {'id': '42'} Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:35.216595 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:35.217497 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.219058 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-130a688d-2638-4bf7-b37c-773e5f20d0a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:35.220332 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-130a688d-2638-4bf7-b37c-773e5f20d0a4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390205 Oct 10 17:01:35.220332 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 10 17:01:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:35.226171 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-91781f65-e6e7-4e8d-bdfa-f2f0a10970b2 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:35.248457 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-91781f65-e6e7-4e8d-bdfa-f2f0a10970b2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025851 Oct 10 17:01:35.248989 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:01:35.261733 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-9df7057c-e26d-4863-a75a-da7f862d1e21 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:35.284932 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-9df7057c-e26d-4863-a75a-da7f862d1e21 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028131 Oct 10 17:01:35.285487 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:01:35.295338 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-7996e247-5ad2-4e0b-b489-a14f5bc533b2 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:35.301873 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.wsgi [None req-7996e247-5ad2-4e0b-b489-a14f5bc533b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-7996e247-5ad2-4e0b-b489-a14f5bc533b2 admin admin] Request method failure captured: Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept: application/json Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept-Encoding: gzip, deflate Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Connection: keep-alive Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Content-Length: 0 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Host: 10.222.0.42 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-System-Scope: None Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: User-Agent: python-novaclient Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Auth-Token: gAAAAABjRE_ui9vcaRbgEhhAEeeNuh5vLulWPgyJ-bbt5yfqol7j39-m0PlRnQIxrOCUAZLM4qa-PM65HkCrnStwyS9z-8VXUMmeCb5I32gHuIu6Zy-DfcjpuSP3r1q4n0_ddllMteTa-9fg7jSLMalpAEyhAQiTyrfDeN8b5KMnDS18NEcDOqQ Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Id: None Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Name: None Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Identity-Status: Confirmed Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Is-Admin-Project: True Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Id: default Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Name: Default Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Name: admin Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Role: reader,member,admin Oct 10 17:01:35.307102 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Roles: reader,member,admin Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant: admin Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Name: admin Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User: admin Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Id: default Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Name: Default Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Name: admin Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: method: > Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: exception: Flavor 42 could not be found. Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: action_args: {'id': '42'} Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:35.308679 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:35.309715 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:35.311018 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-7996e247-5ad2-4e0b-b489-a14f5bc533b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:35.312870 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-7996e247-5ad2-4e0b-b489-a14f5bc533b2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015257 Oct 10 17:01:35.312870 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 10 17:01:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:36.508763 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-9df7057c-e26d-4863-a75a-da7f862d1e21 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:36.509770 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-9df7057c-e26d-4863-a75a-da7f862d1e21 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 10 17:01:36.510169 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:37.023866 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-4102b5d8-2669-483f-b98b-3cf59f918974 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:37.028922 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.wsgi [None req-4102b5d8-2669-483f-b98b-3cf59f918974 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-4102b5d8-2669-483f-b98b-3cf59f918974 admin admin] Request method failure captured: Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept: application/json Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept-Encoding: gzip, deflate Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Connection: keep-alive Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Content-Length: 0 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Host: 10.222.0.42 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-System-Scope: None Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: User-Agent: python-novaclient Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Auth-Token: gAAAAABjRE_wwkZ6CaeJnQR8VmPTpHDyQi2w03kXKbAoBsWJiqudZjYL4SCVB_QDxg2b595lzNRJUi0NO8h4z1tncZ0MlSdSCTuzdOpXHO3_Ogolc2hArwfHFh1RosTTIH4wySFzA6x98OrVcahXmsRy3_EmsLskqpzyz9qlT7oYLLPkl7CyBek Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Id: None Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Name: None Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Identity-Status: Confirmed Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Is-Admin-Project: True Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Id: default Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Name: Default Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Name: admin Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Role: reader,member,admin Oct 10 17:01:37.030446 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Roles: reader,member,admin Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant: admin Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Name: admin Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User: admin Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Id: default Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Name: Default Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Name: admin Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: method: > Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: exception: Flavor 84 could not be found. Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: action_args: {'id': '84'} Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:37.032616 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:37.033596 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.034896 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-4102b5d8-2669-483f-b98b-3cf59f918974 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:37.036142 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-4102b5d8-2669-483f-b98b-3cf59f918974 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385242 Oct 10 17:01:37.036142 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 10 17:01:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:37.042551 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-a7b9077d-1972-4c55-9db9-e6837b1af432 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:37.057150 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-a7b9077d-1972-4c55-9db9-e6837b1af432 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018182 Oct 10 17:01:37.057661 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:01:37.067129 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f47a4a21-1927-48dd-9780-a126b29f57d6 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:37.082723 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f47a4a21-1927-48dd-9780-a126b29f57d6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019335 Oct 10 17:01:37.083242 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:01:37.092215 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-101c61bf-1a72-4aeb-be89-e2014b82233c admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:37.097664 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.wsgi [None req-101c61bf-1a72-4aeb-be89-e2014b82233c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-101c61bf-1a72-4aeb-be89-e2014b82233c admin admin] Request method failure captured: Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept: application/json Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept-Encoding: gzip, deflate Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Connection: keep-alive Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Content-Length: 0 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Host: 10.222.0.42 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-System-Scope: None Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: User-Agent: python-novaclient Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Auth-Token: gAAAAABjRE_wwkZ6CaeJnQR8VmPTpHDyQi2w03kXKbAoBsWJiqudZjYL4SCVB_QDxg2b595lzNRJUi0NO8h4z1tncZ0MlSdSCTuzdOpXHO3_Ogolc2hArwfHFh1RosTTIH4wySFzA6x98OrVcahXmsRy3_EmsLskqpzyz9qlT7oYLLPkl7CyBek Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Id: None Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Name: None Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Identity-Status: Confirmed Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Is-Admin-Project: True Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Id: default Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Name: Default Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Name: admin Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Role: reader,member,admin Oct 10 17:01:37.099134 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Roles: reader,member,admin Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant: admin Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Name: admin Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User: admin Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Id: default Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Name: Default Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Name: admin Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: method: > Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: exception: Flavor 84 could not be found. Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: action_args: {'id': '84'} Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:37.100676 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:37.101643 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:37.103054 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-101c61bf-1a72-4aeb-be89-e2014b82233c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:37.104345 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-101c61bf-1a72-4aeb-be89-e2014b82233c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011645 Oct 10 17:01:37.104345 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 10 17:01:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:38.306920 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f47a4a21-1927-48dd-9780-a126b29f57d6 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:38.310068 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f47a4a21-1927-48dd-9780-a126b29f57d6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 10 17:01:38.310068 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:38.819744 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-83461844-bea8-470e-a68f-6d95c024e07d admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:38.825517 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.wsgi [None req-83461844-bea8-470e-a68f-6d95c024e07d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-83461844-bea8-470e-a68f-6d95c024e07d admin admin] Request method failure captured: Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept: application/json Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Accept-Encoding: gzip, deflate Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Connection: keep-alive Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Content-Length: 0 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Host: 10.222.0.42 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Openstack-System-Scope: None Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: User-Agent: python-novaclient Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Auth-Token: gAAAAABjRE_yenuBuOQ5hWGc-yu9maP6iF0JTLqDLwErP3f6541aFVpBr4_D1l3jw3vJgHTCzpwZZ7PFUWiSMRHVqHGgvx-kVxzQG5iBM_a86YEsSlI3IOQRbSHf_t3mEd-svbgfaCRcxihrYaVzuoZZgAwmwj7jFd-KycUxwKLONKP5T9hNSlY Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Id: None Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Domain-Name: None Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Identity-Status: Confirmed Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Is-Admin-Project: True Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Id: default Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Domain-Name: Default Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Project-Name: admin Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Role: reader,member,admin Oct 10 17:01:38.827011 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Roles: reader,member,admin Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant: admin Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-Tenant-Name: admin Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User: admin Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Id: default Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Domain-Name: Default Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: X-User-Name: admin Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: method: > Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: exception: Flavor 451 could not be found. Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: action_args: {'id': '451'} Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:38.829175 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:38.831243 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.832613 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-83461844-bea8-470e-a68f-6d95c024e07d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:38.833795 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-83461844-bea8-470e-a68f-6d95c024e07d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.384223 Oct 10 17:01:38.833795 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:01:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:38.838653 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-3d677f1d-85eb-4f93-a87b-a52fdc7f1638 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:38.853603 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-3d677f1d-85eb-4f93-a87b-a52fdc7f1638 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018482 Oct 10 17:01:38.854136 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:01:38.863203 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:38.878671 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018900 Oct 10 17:01:38.879327 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 10 17:01:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:01:38.888822 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-91d324bf-5080-4542-848c-34c13260f701 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:38.894438 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.wsgi [None req-91d324bf-5080-4542-848c-34c13260f701 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-91d324bf-5080-4542-848c-34c13260f701 admin admin] Request method failure captured: Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept: application/json Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Accept-Encoding: gzip, deflate Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Connection: keep-alive Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Content-Length: 0 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Host: 10.222.0.42 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-Api-Version: compute 2.92 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Openstack-System-Scope: None Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: User-Agent: python-novaclient Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Auth-Token: gAAAAABjRE_yenuBuOQ5hWGc-yu9maP6iF0JTLqDLwErP3f6541aFVpBr4_D1l3jw3vJgHTCzpwZZ7PFUWiSMRHVqHGgvx-kVxzQG5iBM_a86YEsSlI3IOQRbSHf_t3mEd-svbgfaCRcxihrYaVzuoZZgAwmwj7jFd-KycUxwKLONKP5T9hNSlY Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Id: None Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Domain-Name: None Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Identity-Status: Confirmed Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Is-Admin-Project: True Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Id: default Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Domain-Name: Default Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Project-Name: admin Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Role: reader,member,admin Oct 10 17:01:38.895960 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Roles: reader,member,admin Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3acc8f5bcdf4b42bd810be11a69d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3acc8f5bcdf4b42bd810be11a69d5c4"}]}] Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant: admin Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Id: b3acc8f5bcdf4b42bd810be11a69d5c4 Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-Tenant-Name: admin Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User: admin Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Id: default Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Domain-Name: Default Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Id: 6f35dce3202646389d8bcfb32df2d4b4 Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: X-User-Name: admin Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: method: > Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: exception: Flavor 451 could not be found. Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: action_args: {'id': '451'} Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:01:38.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:38.898304 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: ERROR nova.api.openstack.wsgi Oct 10 17:01:38.899353 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-91d324bf-5080-4542-848c-34c13260f701 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:01:38.900413 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-91d324bf-5080-4542-848c-34c13260f701 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012159 Oct 10 17:01:38.900413 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:01:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:40.102129 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:40.106022 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 10 17:01:40.106022 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:40.619368 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-9851540a-aa24-4794-aa65-90b6a246bf61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:40.694816 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-9851540a-aa24-4794-aa65-90b6a246bf61 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.455256 Oct 10 17:01:40.695372 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 10 17:01:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:41.896751 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:41.897762 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 10 17:01:41.898156 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:42.413110 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-746353cd-86dd-404d-becb-30515e459469 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:42.488968 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-746353cd-86dd-404d-becb-30515e459469 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.453711 Oct 10 17:01:42.489447 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 10 17:01:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:43.704405 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:43.705453 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 10 17:01:43.705846 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:44.219466 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-fe9e0017-2c3f-4ca4-b934-35ce90c79861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:44.284196 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-fe9e0017-2c3f-4ca4-b934-35ce90c79861 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.443526 Oct 10 17:01:44.284748 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 10 17:01:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:45.502625 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:45.503624 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 10 17:01:45.504103 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:46.013168 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f56ef1b2-0d86-4ceb-8aa9-1d88ff411b80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:01:46.100253 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f56ef1b2-0d86-4ceb-8aa9-1d88ff411b80 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460201 Oct 10 17:01:46.100820 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 10 17:01:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:01:47.300742 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:47.301733 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 10 17:01:47.302125 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:01:47.809653 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-5d7fb32d-218f-400e-b795-a89db3b2f50d admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:01:47.831359 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-5d7fb32d-218f-400e-b795-a89db3b2f50d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.392620 Oct 10 17:01:47.831907 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Oct 10 17:01:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:02:44.342025 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.343629 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-bc5c3925-d2e7-48cc-82b3-a888dc14ddf3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Oct 10 17:02:44.344043 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:02:44.354501 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:44.732669 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-1285f9b2-7159-416c-b99b-95648536afd5 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.753499 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-1285f9b2-7159-416c-b99b-95648536afd5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403415 Oct 10 17:02:44.754042 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:02:44.775199 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG dbcounter [-] [104216] Writing DB stats nova_api:SELECT=14 {{(pid=104216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:44.779037 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-8d25f34d-c6b5-4f39-926f-cb10b97d7efc admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.786268 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-8d25f34d-c6b5-4f39-926f-cb10b97d7efc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012502 Oct 10 17:02:44.786796 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:02:44.798431 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-a14589d8-51da-4255-9b4b-406912aa2131 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.805891 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-a14589d8-51da-4255-9b4b-406912aa2131 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011109 Oct 10 17:02:44.806408 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:02:44.818554 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.825935 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011034 Oct 10 17:02:44.827810 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:02:44.838194 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-90bf7548-96ad-403d-bc15-c52b1212d40c admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:02:44.845214 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-90bf7548-96ad-403d-bc15-c52b1212d40c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010526 Oct 10 17:02:44.845760 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Oct 10 17:02:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:06:09.048721 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:09.049726 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Oct 10 17:06:09.050118 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:06:09.190620 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_api:SELECT=6 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:09.332694 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:09.337257 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:09.337727 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:09.338145 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:09.338846 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:09.339286 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:09.339696 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:09.371288 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-e096cb71-f61f-43d4-b22d-45d97b35b560 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.182111 Oct 10 17:06:09.371830 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:06:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:06:10.443128 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:10.444195 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 10 17:06:10.444554 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:06:10.641430 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:10.644232 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:10.644703 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:10.645131 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:10.645829 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:10.646261 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:10.646667 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:10.667814 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-37d81594-6d25-4eea-9019-085411ecc9f4 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083545 Oct 10 17:06:10.668433 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:06:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:06:22.147955 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:22.149001 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 10 17:06:22.149384 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:06:22.291907 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_cell0:SELECT=4 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:22.292675 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_cell1:SELECT=4 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:22.293287 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG dbcounter [-] [104217] Writing DB stats nova_api:SELECT=8 {{(pid=104217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:22.343577 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:22.344372 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:22.344845 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:22.345268 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:22.346006 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:22.346475 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:22.346886 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:22.372613 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-47a862f6-2d5e-401f-baf5-29bd1ee976ab admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084939 Oct 10 17:06:22.373109 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:06:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:06:23.441232 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: DEBUG nova.api.openstack.wsgi [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] Calling method '>' {{(pid=104216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:23.442230 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: INFO nova.api.openstack.requestlog [None req-eee317f2-52f0-41d3-b554-31e1a17b0847 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 10 17:06:23.442628 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: [pid: 104216|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 10 17:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:06:23.632399 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG nova.api.openstack.wsgi [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Calling method '>' {{(pid=104217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:06:23.635799 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:23.636431 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:23.637394 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:23.638105 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:06:23.638547 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:06:23.638968 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: DEBUG oslo_concurrency.lockutils [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:06:23.660100 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: INFO nova.api.openstack.requestlog [None req-f55c387e-fe65-4bcb-897a-d772cf222175 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078873 Oct 10 17:06:23.660580 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: [pid: 104217|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 10 17:06:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:07:20.353411 dv-cinder-834540-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 17:07:20.354689 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: Mon Oct 10 17:07:20 2022 - graceful shutdown triggered... Oct 10 17:07:20.355667 dv-cinder-834540-2-iscsi devstack@n-api.service[104217]: Gracefully killing worker 2 (pid: 104217)... Oct 10 17:07:20.356295 dv-cinder-834540-2-iscsi devstack@n-api.service[104216]: Gracefully killing worker 1 (pid: 104216)... Oct 10 17:07:21.355328 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: worker 1 buried after 1 seconds Oct 10 17:07:21.356392 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: worker 2 buried after 1 seconds Oct 10 17:07:21.356392 dv-cinder-834540-2-iscsi devstack@n-api.service[104215]: goodbye to uWSGI. Oct 10 17:07:21.357400 dv-cinder-834540-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 10 17:07:21.357964 dv-cinder-834540-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 17:07:21.360754 dv-cinder-834540-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 17:07:21.370985 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 17:07:21.373549 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 17:07:21 2022] *** Oct 10 17:07:21.373703 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 17:07:21.373833 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 17:07:21.373944 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: nodename: dv-cinder-834540-2-iscsi Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: machine: x86_64 Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: clock source: unix Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: pcre jit disabled Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: detected number of CPU cores: 4 Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: current working directory: / Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: detected binary path: /usr/bin/uwsgi-core Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: your processes number limit is 47680 Oct 10 17:07:21.374071 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: your memory page size is 4096 bytes Oct 10 17:07:21.374623 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: detected max file descriptor number: 2048 Oct 10 17:07:21.374623 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: lock engine: pthread robust mutexes Oct 10 17:07:21.374623 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: thunder lock: enabled Oct 10 17:07:21.374623 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 17:07:21.374623 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 17:07:21.414641 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: Python main interpreter initialized at 0x5635d460a9c0 Oct 10 17:07:21.414641 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: python threads support enabled Oct 10 17:07:21.414641 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: your server socket listen backlog is limited to 100 connections Oct 10 17:07:21.414641 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: your mercy for graceful operations on workers is 90 seconds Oct 10 17:07:21.415091 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 17:07:21.415091 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: *** Operational MODE: preforking *** Oct 10 17:07:21.415391 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: *** uWSGI is running in multiple interpreter mode *** Oct 10 17:07:21.415391 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: spawned uWSGI master process (pid: 119248) Oct 10 17:07:21.415599 dv-cinder-834540-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 17:07:21.417140 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: spawned uWSGI worker 1 (pid: 119263, cores: 1) Oct 10 17:07:21.417140 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: spawned uWSGI worker 2 (pid: 119264, cores: 1) Oct 10 17:07:21.417140 dv-cinder-834540-2-iscsi devstack@n-api.service[119248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 17:07:22.071899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 17:07:22.072507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 17:07:23.238522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 17:07:23.238522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: from cryptography.utils import int_from_bytes Oct 10 17:07:23.239168 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 17:07:23.239168 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: from cryptography.utils import int_from_bytes Oct 10 17:07:23.239739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 17:07:23.239739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: from cryptography.utils import int_from_bytes Oct 10 17:07:23.240211 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 17:07:23.240211 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: from cryptography.utils import int_from_bytes Oct 10 17:07:25.635488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 17:07:25.636173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 17:07:25.636280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 17:07:25.637357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 17:07:25.637466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 17:07:25.637818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 17:07:25.637895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 17:07:25.637975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.638079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.638167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 17:07:25.638452 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.638576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 17:07:25.638665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 17:07:25.638750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.638988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.639090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.639299 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.639411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.639621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.639754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.640991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834540-2-iscsi {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641752 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.641908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642054 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642585 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642736 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834540-2-iscsi {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.642930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643087 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643473 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.643931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.644134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.644316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.644648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.644972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.645485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.645801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.646083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.646260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.646426 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.646637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.646806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647036 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.647979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.648336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.648589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.648851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.649059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.649059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.649516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834540-2-iscsi {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.649735 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.649959 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.650168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.650346 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.650536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.650719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.650876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834540-2-iscsi {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.651884 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.652085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.652085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653548 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.653858 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.654011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.654162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.654475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.654654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.654821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.655170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.655345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.655519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.655823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.656969 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.657974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.658126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.661275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.661275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.661625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.661790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.661947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.662863 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663778 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.663927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.664116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.664283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.664441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.664594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.665989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666652 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666735 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.666923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667200 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.667929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.668006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.668106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.673813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.673813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.673992 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674073 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674377 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674455 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674742 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.674965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675769 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.675929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676121 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676766 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.676998 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677542 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677694 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677772 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.677993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678212 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678511 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678588 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.678953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.679963 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.680651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.680769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.680923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681307 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.681990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.682109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.682219 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.682329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.682650 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.683758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.683934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684107 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.684862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685315 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685626 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685782 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.685926 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686067 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.686983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.687893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.688064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.688224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.688382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 17:07:25.688532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.688680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.688829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.688977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689119 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689435 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.689875 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.690027 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.690169 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.690575 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.690721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.690868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691766 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.691938 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692439 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.692923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.693203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.693354 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.693511 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.693931 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.694975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.695976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696648 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.696949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.697826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698158 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698314 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698745 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.698885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.699549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.699747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.699905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.700974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701158 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701315 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.701920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702202 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.702948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.703097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.703409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.703560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.703702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704297 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.704980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705572 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.705876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706026 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706625 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.706928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707219 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.707924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.708896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709121 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709594 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709743 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.709894 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.710920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.711079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.711418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.711570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.711712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.711867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712187 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.712956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.713105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.713400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.713554 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.713706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.713856 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.714253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.714407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.714550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.715268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.715433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.715586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.715777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.715929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716112 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716573 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.716863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717168 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717310 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.717902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718489 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718788 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.718945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719087 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.719982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.720898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721039 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721538 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721682 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.721974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722256 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722568 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.722878 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.723932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.724108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.724505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.725244 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.725395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.725548 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.725701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.725861 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.726599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.726775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.726944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727764 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.727915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.728947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729248 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.729979 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.730915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.731996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732624 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.732930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733819 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.733932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.734951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735373 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.735949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.742764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.742881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.742988 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.743982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.744972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745156 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.745965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746050 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746403 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.746938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.747645 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748519 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748601 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748882 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.748972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749414 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749499 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.749942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.750930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751101 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751554 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.751952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752200 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.752975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753558 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.753645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754270 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754720 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.754943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755349 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755652 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755905 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.755999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756483 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756572 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756839 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.756925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.757974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758711 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.758982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759067 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759439 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759885 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.759976 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.760969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.761086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.761086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.761374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.761374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762382 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.762927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763021 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763202 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763354 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763791 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.763941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764361 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764434 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764726 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.764876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765148 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.765549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766534 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.766664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767735 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.767975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.771580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.771682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.771682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.771856 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.771945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772455 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772735 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.772928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773021 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.773947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774306 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.774946 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.775831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776413 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.776967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.777060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.777209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.777848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.777974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778088 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.778993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779569 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779789 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.779933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.780998 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781084 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.781813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782737 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.782974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783891 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.783986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.784961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785315 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.785895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.786846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787693 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.787797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788568 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.788949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.789661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790370 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790458 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.790914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.791921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.792972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793179 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.793913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794448 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.794872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795200 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795689 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.795808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.796072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.796728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.796810 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.796883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.796968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.797979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.798273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.798752 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.798840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.798922 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799084 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.799919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.800221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.800376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.800554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.800728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.800867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801038 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.801879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.802862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803693 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.803800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804137 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.804862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805158 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.805766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806510 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.806751 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807319 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.807966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.808085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.808166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.809416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.809626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.809706 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.809870 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.809961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810204 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810589 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.810973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.811917 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.812944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813101 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.813880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814839 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.814989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.815137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.815286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.815709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.815861 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.816913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817213 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817512 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817834 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.817995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.818144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.818294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.818539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.818707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.818877 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.819429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.819611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.819611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.819908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820708 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.820870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821601 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.821919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822467 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822714 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.822939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823627 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.823857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.824000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.829142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.829672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.829770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.829770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.829953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830396 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830487 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.830922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831155 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831580 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.831949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832426 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832512 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.832919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833694 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.833980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834172 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834718 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834878 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.834961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835265 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835607 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.835961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836067 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836495 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836775 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.836967 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.837978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.838927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.839151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.839372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.839838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.839986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840307 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.840981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841448 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841775 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.841960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.842924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843547 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.843857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.844939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845104 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845247 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845737 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.845881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846763 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.846933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.847919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848204 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.848987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.849129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.849272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.849445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.849575 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.849995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.850977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851435 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.851925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852337 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.852863 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853005 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.853911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854090 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854696 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.854854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855139 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855338 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.855989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.856135 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.856321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.856442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.858616 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.858808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.859060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.859222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.859373 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.859523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.859679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.860179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.860390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.860549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.860712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.860872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861022 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861502 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.861800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.863825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.864739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.864913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.865753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866361 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.866834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.867951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.868126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.868296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.868456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.868627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.868860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.869759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.870522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.870703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.871387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.871581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.871739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.871898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.872235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.872419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.872581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.872732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.872882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873031 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873524 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873689 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.873991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874140 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.874931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.875995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876187 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.876949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.877880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.878852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.879924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.880129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.880612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.880779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.880931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881094 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.881866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882175 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882780 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.882907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883250 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883369 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.883948 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.884078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.887956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888736 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.888919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889369 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.889984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890076 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890468 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.890910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891369 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891652 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.891925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892154 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.892963 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893330 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.893945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894039 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894211 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894397 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894828 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.894981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895529 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.895966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896743 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.896914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.897925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898292 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898548 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898634 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.898924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.899817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.900761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.901897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.902562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.902562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.902904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.903234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.903552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.903866 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.904195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 17:07:25.904498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 17:07:25.962399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO dbcounter [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Registered counter for database nova_api Oct 10 17:07:25.967338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO dbcounter [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Registered counter for database nova_api Oct 10 17:07:25.982736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_db.sqlalchemy.engines [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:25.987645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_db.sqlalchemy.engines [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:25.989938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writer thread running {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:25.995191 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writer thread running {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.046942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.context [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faa300-58d0-4d9b-bfd7-9b3182920878(cell1) {{(pid=119264) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 17:07:26.050975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:07:26.051454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:07:26.053100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:07:26.053837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:07:26.054287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:07:26.055419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.context [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faa300-58d0-4d9b-bfd7-9b3182920878(cell1) {{(pid=119263) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 17:07:26.056339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:07:26.058881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO dbcounter [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Registered counter for database nova_cell0 Oct 10 17:07:26.060451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:07:26.061278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:07:26.062849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:07:26.063106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO dbcounter [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Registered counter for database nova_cell1 Oct 10 17:07:26.063599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:07:26.064137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:07:26.066809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:07:26.068874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO dbcounter [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Registered counter for database nova_cell0 Oct 10 17:07:26.070734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_db.sqlalchemy.engines [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.072986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_db.sqlalchemy.engines [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.073329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO dbcounter [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Registered counter for database nova_cell1 Oct 10 17:07:26.081808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writer thread running {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.082181 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writer thread running {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.082813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_db.sqlalchemy.engines [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.085472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_db.sqlalchemy.engines [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.089896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writer thread running {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.229480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writer thread running {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.231108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO dbcounter [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Registered counter for database nova_cell0 Oct 10 17:07:26.238492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_db.sqlalchemy.engines [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.241141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO dbcounter [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Registered counter for database nova_cell0 Oct 10 17:07:26.243162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writer thread running {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.248324 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_db.sqlalchemy.engines [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 17:07:26.252705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writer thread running {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 17:07:26.568902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: WARNING keystonemiddleware.auth_token [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 17:07:26.576010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: WARNING keystonemiddleware.auth_token [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 17:07:26.576284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: WARNING keystonemiddleware.auth_token [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 17:07:26.583417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: WARNING keystonemiddleware.auth_token [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 17:07:26.937707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: WARNING keystonemiddleware.auth_token [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 17:07:26.938393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: WARNING keystonemiddleware.auth_token [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 17:07:26.944045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: WARNING keystonemiddleware.auth_token [None req-36188d1b-ea26-4f7f-904e-d983617058b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 17:07:26.944809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: WARNING keystonemiddleware.auth_token [None req-c6c6b7b8-1c4b-4dfb-8c9a-b0fe1912cfb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 17:07:26.949915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635d460a9c0 pid: 119263 (default app) Oct 10 17:07:26.950821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635d460a9c0 pid: 119264 (default app) Oct 10 17:08:03.670794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.672380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.673386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.674439 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.796072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.797939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.798965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:03.800192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:04.968805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-73862c3d-49f4-4466-87f8-c56fcc8678a3 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Action: 'create', calling method: .version_select at 0x7f34f03bd550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-574653098", "metadata": {"Type": "work"}}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:05.031847 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-24c9f5c7-ec1a-4489-b024-92eb958c1d57 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Action: 'create', calling method: .version_select at 0x7f34f03ba550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1945927349"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:07.881090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-73862c3d-49f4-4466-87f8-c56fcc8678a3 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.231619 Oct 10 17:08:07.884533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 10 17:08:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4234 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 17:08:07.901892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f3df664b-47d7-45e3-8613-a2d4993bbb5a tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f0291430>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:08.352335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f3df664b-47d7-45e3-8613-a2d4993bbb5a tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 200 len: 352 microversion: 2.1 time: 0.455691 Oct 10 17:08:08.353285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:07 2022] GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 352 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:08.800106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-24c9f5c7-ec1a-4489-b024-92eb958c1d57 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.021987 Oct 10 17:08:08.801815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Oct 10 17:08:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5026 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 10 17:08:08.821454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-16eebe79-f406-4090-8867-407547fb8cff tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0291af0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:08.901845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-16eebe79-f406-4090-8867-407547fb8cff tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 200 len: 345 microversion: 2.1 time: 0.086793 Oct 10 17:08:08.901845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:08 2022] GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:09.369530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0a3ec6b3-7fe3-4997-a5ba-050687d734df tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f0291430>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:09.615107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0a3ec6b3-7fe3-4997-a5ba-050687d734df tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 200 len: 353 microversion: 2.1 time: 0.242123 Oct 10 17:08:09.618695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 2/5] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:09 2022] GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:09.643605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cc6b2508-5225-4d32-a5c6-1e2e1b2ac148 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f0229280>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:09.804853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cc6b2508-5225-4d32-a5c6-1e2e1b2ac148 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 200 len: 353 microversion: 2.1 time: 0.178984 Oct 10 17:08:09.819012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 4/6] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:09 2022] GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:09.821787 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2f17a220-5eff-427b-b73b-dbfe63ab9d4a tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f0291b80>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:09.915385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4b292e46-5ed0-4d60-8069-c5a7c1eb1a4e tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0291d30>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:10.097230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4b292e46-5ed0-4d60-8069-c5a7c1eb1a4e tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 200 len: 346 microversion: 2.1 time: 0.186398 Oct 10 17:08:10.098355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 5/7] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:09 2022] GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:08:10.111912 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f2c31d62-b68c-45ea-8487-63e4d7112aea tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Action: 'create', calling method: .version_select at 0x7f34f0291550>, body: {"snapshot": {"volume_id": "20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1194591733"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:10.181522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2f17a220-5eff-427b-b73b-dbfe63ab9d4a tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 202 len: 0 microversion: 2.1 time: 0.364733 Oct 10 17:08:10.186773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 3/8] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:08:09 2022] DELETE /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:08:10.194287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-db56de24-5a33-4b36-a5fb-af9c18022970 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f022d280>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:10.355460 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-db56de24-5a33-4b36-a5fb-af9c18022970 tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 200 len: 352 microversion: 2.1 time: 0.162344 Oct 10 17:08:10.358318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 4/9] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:10 2022] GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:10.946028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f2c31d62-b68c-45ea-8487-63e4d7112aea tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.838364 Oct 10 17:08:10.950401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 6/10] 10.222.0.42 () {60 vars in 1162 bytes} [Mon Oct 10 17:08:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:10.961606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d7d80957-716f-4417-b2a5-53e051b1b978 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0291dc0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:11.039858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d7d80957-716f-4417-b2a5-53e051b1b978 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.081861 Oct 10 17:08:11.040857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 5/11] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:10 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:11.055155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3b3cf849-acc3-4628-aff0-1020f4516adf tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0229d30>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:11.172755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3b3cf849-acc3-4628-aff0-1020f4516adf tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.123191 Oct 10 17:08:11.173534 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Oct 10 17:08:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:11.185001 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-59c241f1-988c-4cf2-837e-7a741ccda481 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f02915e0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:11.246768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-59c241f1-988c-4cf2-837e-7a741ccda481 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.065522 Oct 10 17:08:11.248453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:11 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:11.367662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef54dd18-2236-4a43-8d07-559fb22e188c tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Calling method '.version_select at 0x7f34f02914c0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:11.417770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-ef54dd18-2236-4a43-8d07-559fb22e188c tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] HTTP exception thrown: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef54dd18-2236-4a43-8d07-559fb22e188c tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Request method failure captured: Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d HTTP/1.1 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFFzA65PE3hGr6qW8J0jfEZVUdM34wSS_u7drfNA8_05x7Mfsp_pDuYEbg3F_zLMdFrILD5xKUMdoETA25nf6j0T0K0eXo8RpHiKXG1pe-1V5xG_X30FuJ-bnvDdNpEHLhq8xv28_yy1kRvKZ7qkWZ6xbqkwM7cX0K7UUr1Qr0ySVK4 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 3f5f061a8d22484faf392b34320f17b3 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesGetTestJSON-2101700057 Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:11.422372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3f5f061a8d22484faf392b34320f17b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3f5f061a8d22484faf392b34320f17b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3f5f061a8d22484faf392b34320f17b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3f5f061a8d22484faf392b34320f17b3"}]}] Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesGetTestJSON-2101700057 Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 3f5f061a8d22484faf392b34320f17b3 Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesGetTestJSON-2101700057 Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesGetTestJSON-2101700057-project Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: d630884096ad491bbf26959cdb0f28a2 Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesGetTestJSON-2101700057-project Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '76e59073-966d-400f-9b96-cf340996949d'} Oct 10 17:08:11.423699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. (HTTP 404) (Request-ID: req-e3278ef1-771f-4c4d-9979-0034a9fa74e3) Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:11.424833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:11.426663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 17:08:11.427896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef54dd18-2236-4a43-8d07-559fb22e188c tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] Returning 404 to user: Volume 76e59073-966d-400f-9b96-cf340996949d could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef54dd18-2236-4a43-8d07-559fb22e188c tempest-VolumesGetTestJSON-2101700057 tempest-VolumesGetTestJSON-2101700057-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d" status: 404 len: 109 microversion: 2.1 time: 0.062685 Oct 10 17:08:11.434876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:11 2022] GET /compute/v2.1/os-volumes/76e59073-966d-400f-9b96-cf340996949d => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:12.261054 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-645a8790-f1f3-4449-bca3-f5f2fe194626 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f022d310>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:12.439418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-645a8790-f1f3-4449-bca3-f5f2fe194626 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.182296 Oct 10 17:08:12.439984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:12 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:13.460582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-aa879995-c4d9-4985-a798-1f8943ee11da tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0291820>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:13.499507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-aa879995-c4d9-4985-a798-1f8943ee11da tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.051506 Oct 10 17:08:13.504070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:13 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:08:14.514088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-31b55cae-c4e5-47e4-b183-edaf5ce2d4e2 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f02915e0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:14.582226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-31b55cae-c4e5-47e4-b183-edaf5ce2d4e2 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.073751 Oct 10 17:08:14.587385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:14 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:15.600341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1957bb53-9da6-43bd-881d-e1f9d04a0065 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0beeaf0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:15.666885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1957bb53-9da6-43bd-881d-e1f9d04a0065 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 288 microversion: 2.1 time: 0.075007 Oct 10 17:08:15.667756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:15 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:15.684394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-93c2f572-858d-452a-b116-3241680a0de3 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0291d30>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:15.968391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-93c2f572-858d-452a-b116-3241680a0de3 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 202 len: 0 microversion: 2.1 time: 0.286244 Oct 10 17:08:15.968391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Oct 10 17:08:15 2022] DELETE /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:08:15.974995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c5c73e22-8239-4704-806c-c5d28b67d46f tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f0230790>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:16.035329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c5c73e22-8239-4704-806c-c5d28b67d46f tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.064379 Oct 10 17:08:16.035975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:15 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:17.356394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-106091817", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "networks": [{"uuid": "aea7132b-eded-454c-814f-84881d978853"}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:17.531635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] validate_networks() for [('aea7132b-eded-454c-814f-84881d978853', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:08:17.725990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-efe9d0f1-68ad-42af-ad17-060c23a8f70f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: .version_select at 0x7f34f02300d0>, body: {"keypair": {"name": "tempest-keypair-1185581588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaAeHD+g0fYD5JahIXlfHyjBPS4QxbFAivzQp9IpeDEJPn8Hnko/ouxJ5K9pNcl2VCKlACBZ7gzjPtEgtX3v9FTKuPlT1Vn7gSbTwVVc7ZwDwz2aqL9nGh9ZAd7Ie4bXA=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:17.916989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-efe9d0f1-68ad-42af-ad17-060c23a8f70f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for project 34f584f725354f68b917b45b645b3630. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:08:17.946951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-efe9d0f1-68ad-42af-ad17-060c23a8f70f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for user b8507de448b6455fb792bda0c949421d and project 34f584f725354f68b917b45b645b3630. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:08:18.217661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-efe9d0f1-68ad-42af-ad17-060c23a8f70f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.246945 Oct 10 17:08:18.226362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 12/21] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Oct 10 17:08:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 17:08:18.232367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-491ac262-5bb9-44dd-a86e-f9a8e72b4247 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f01e0c10>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:18.293607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-491ac262-5bb9-44dd-a86e-f9a8e72b4247 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 200 len: 287 microversion: 2.1 time: 0.065883 Oct 10 17:08:18.295485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:18 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:18.604681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7e3ab50f-6cd1-442c-9a18-4f92a40611e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: .version_select at 0x7f34f019a280>, body: {"keypair": {"name": "tempest-keypair-2098437952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeRhwyl5HoioCbBPfnB8qcBCVMgTop5GGSxeqXY4oKWKlcm0IsDu5yNjAMxJyIvQm2Z2xjF9s9PG0O9frwHf8pI6N7JklCvxloV3oW+AXZTTNFN8FI0zVdNa9AuMaZluw=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:18.629080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-7e3ab50f-6cd1-442c-9a18-4f92a40611e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for project 18aef1375628417b91f816bccd05d1cf. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:08:18.640338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-7e3ab50f-6cd1-442c-9a18-4f92a40611e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for user 8bb27ad53d4a454eb10268ab27ad3258 and project 18aef1375628417b91f816bccd05d1cf. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:08:18.741617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7e3ab50f-6cd1-442c-9a18-4f92a40611e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.374690 Oct 10 17:08:18.745106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 14/23] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:08:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8f99421a-615e-46d0-b68c-0eac71cdd4db tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f019a5e0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-8f99421a-615e-46d0-b68c-0eac71cdd4db tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] HTTP exception thrown: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8f99421a-615e-46d0-b68c-0eac71cdd4db tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Request method failure captured: Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 HTTP/1.1 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFFzYt0MQOj34XMZ1-4tKDRtYuaEOJ1CKI862rQWCd6N83Wv_yxM4UcAa21cNVvh9-7frdipmKa9-PZO_AIBBT1LNtVifSYF7ufniy8wpgepLaZmQt9gYgTiVoTtPln0gqhvju2jsXVRXLBE8H7tgzMZXzMXrsqlQ8BV6cak5N_dJJY Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:19.508192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3ec355ce8444446afea97b72da044a4"}]}] Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 5e09aafc4a9644d4acc2303fff71913f Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'f7958ca4-47a7-448b-8755-6fd8ed5eb161'} Oct 10 17:08:19.517984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. (HTTP 404) (Request-ID: req-b16e84f7-c793-4ff7-8619-06dab39576df) Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.519301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:19.521716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 10 17:08:19.523749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8f99421a-615e-46d0-b68c-0eac71cdd4db tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Returning 404 to user: Snapshot f7958ca4-47a7-448b-8755-6fd8ed5eb161 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8f99421a-615e-46d0-b68c-0eac71cdd4db tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161" status: 404 len: 111 microversion: 2.1 time: 0.072894 Oct 10 17:08:19.533143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 15/24] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 10 17:08:19 2022] GET /compute/v2.1/os-snapshots/f7958ca4-47a7-448b-8755-6fd8ed5eb161 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:19.535708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8f3e758a-1e1c-422d-a905-fd166478e690 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f01e0700>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:19.536128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:08:19.536128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:08:19.536128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:08:19.536128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:08:19.536128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:08:19.583276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:19.587274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:19.587734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:19.594300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:19.596744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:19.600059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:19.657947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Getting quotas for project f9c633053a92460c8fd6858e66679fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:08:19.670118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Getting quotas for user f6d39546d0504953a4f9d769db9421a8 and project f9c633053a92460c8fd6858e66679fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:08:19.692313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:08:19.695750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:08:19.772739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8f3e758a-1e1c-422d-a905-fd166478e690 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 202 len: 0 microversion: 2.1 time: 0.383073 Oct 10 17:08:19.772739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 16/25] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:08:19 2022] DELETE /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:08:19.786686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c77d5588-7e0c-4362-8a1a-a3feac12d2b5 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f03bdee0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:19.944477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c77d5588-7e0c-4362-8a1a-a3feac12d2b5 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 200 len: 345 microversion: 2.1 time: 0.166758 Oct 10 17:08:19.952728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 17/26] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:19 2022] GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:19.958086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1f710fce-d153-4ac0-aa81-84b763ccab67 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.165520 Oct 10 17:08:19.972016 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2b114a4c-33c5-47a5-9ee1-94b7f597d850 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:19.973103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2b114a4c-33c5-47a5-9ee1-94b7f597d850 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:19.978345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 10/27] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:08:20.195307 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2b114a4c-33c5-47a5-9ee1-94b7f597d850 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:20.226339 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2b114a4c-33c5-47a5-9ee1-94b7f597d850 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1214 microversion: 2.1 time: 0.258440 Oct 10 17:08:20.226927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:19 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:20.909021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4fd75e48-c581-4fa5-bc41-ded2be10fb42 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef9405e0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:20.967196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9612328e-129e-4fc5-b185-32f9d77a5e29 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f019caf0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:21.027173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-9612328e-129e-4fc5-b185-32f9d77a5e29 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] HTTP exception thrown: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.031002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4fd75e48-c581-4fa5-bc41-ded2be10fb42 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/892e28b3-c0fd-459a-97e7-8f053d1e7273" status: 200 len: 350 microversion: 2.1 time: 0.126230 Oct 10 17:08:21.041734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 11/29] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:20 2022] GET /compute/v2.1/os-volumes/892e28b3-c0fd-459a-97e7-8f053d1e7273 => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9612328e-129e-4fc5-b185-32f9d77a5e29 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Request method failure captured: Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 HTTP/1.1 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFFzYt0MQOj34XMZ1-4tKDRtYuaEOJ1CKI862rQWCd6N83Wv_yxM4UcAa21cNVvh9-7frdipmKa9-PZO_AIBBT1LNtVifSYF7ufniy8wpgepLaZmQt9gYgTiVoTtPln0gqhvju2jsXVRXLBE8H7tgzMZXzMXrsqlQ8BV6cak5N_dJJY Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:21.042722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3ec355ce8444446afea97b72da044a4"}]}] Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 5e09aafc4a9644d4acc2303fff71913f Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43'} Oct 10 17:08:21.043942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. (HTTP 404) (Request-ID: req-9b119e39-0ca8-47f5-adc4-b0b11551987d) Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.044596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:21.045496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 17:08:21.046356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.047350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.048968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9612328e-129e-4fc5-b185-32f9d77a5e29 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Returning 404 to user: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:21.050420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9612328e-129e-4fc5-b185-32f9d77a5e29 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 404 len: 109 microversion: 2.1 time: 0.089446 Oct 10 17:08:21.051421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 19/30] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:20 2022] GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:21.066032 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bab86a8c-f363-4764-87af-711f7bb657bc tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34ef940820>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:21.127586 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-bab86a8c-f363-4764-87af-711f7bb657bc tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] HTTP exception thrown: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bab86a8c-f363-4764-87af-711f7bb657bc tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Request method failure captured: Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 HTTP/1.1 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFFzYt0MQOj34XMZ1-4tKDRtYuaEOJ1CKI862rQWCd6N83Wv_yxM4UcAa21cNVvh9-7frdipmKa9-PZO_AIBBT1LNtVifSYF7ufniy8wpgepLaZmQt9gYgTiVoTtPln0gqhvju2jsXVRXLBE8H7tgzMZXzMXrsqlQ8BV6cak5N_dJJY Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:08:21.145621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3ec355ce8444446afea97b72da044a4"}]}] Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 5e09aafc4a9644d4acc2303fff71913f Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43'} Oct 10 17:08:21.146691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. (HTTP 404) (Request-ID: req-24e3455c-8dc3-4b99-aff2-1acd07c3bae6) Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.147302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:21.148292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 17:08:21.149339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.150277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bab86a8c-f363-4764-87af-711f7bb657bc tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Returning 404 to user: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:21.155675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bab86a8c-f363-4764-87af-711f7bb657bc tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 404 len: 109 microversion: 2.1 time: 0.088623 Oct 10 17:08:21.160154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 12/31] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:08:21 2022] DELETE /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:21.170995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-95dbdc6a-2932-4b4e-a566-5407110de483 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Calling method '.version_select at 0x7f34f01e0e50>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:21.253717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-95dbdc6a-2932-4b4e-a566-5407110de483 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] HTTP exception thrown: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-95dbdc6a-2932-4b4e-a566-5407110de483 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Request method failure captured: Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 HTTP/1.1 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFFzYt0MQOj34XMZ1-4tKDRtYuaEOJ1CKI862rQWCd6N83Wv_yxM4UcAa21cNVvh9-7frdipmKa9-PZO_AIBBT1LNtVifSYF7ufniy8wpgepLaZmQt9gYgTiVoTtPln0gqhvju2jsXVRXLBE8H7tgzMZXzMXrsqlQ8BV6cak5N_dJJY Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:21.261178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3ec355ce8444446afea97b72da044a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3ec355ce8444446afea97b72da044a4"}]}] Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f3ec355ce8444446afea97b72da044a4 Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-221918692 Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 5e09aafc4a9644d4acc2303fff71913f Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-221918692-project Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43'} Oct 10 17:08:21.262236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. (HTTP 404) (Request-ID: req-eebfef76-1d1e-4d83-bc8d-158570473ef3) Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.262851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:21.263986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 17:08:21.264885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-95dbdc6a-2932-4b4e-a566-5407110de483 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] Returning 404 to user: Volume 20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:21.265730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-95dbdc6a-2932-4b4e-a566-5407110de483 tempest-VolumesSnapshotsTestJSON-221918692 tempest-VolumesSnapshotsTestJSON-221918692-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43" status: 404 len: 109 microversion: 2.1 time: 0.102161 Oct 10 17:08:21.269031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 20/32] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:21 2022] GET /compute/v2.1/os-volumes/20cb39b1-76b8-4dc4-a5e6-0d4c6a103b43 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:21.274266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0fbb75b6-4ade-4c9c-bab3-4129053bfe66 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:21.274994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0fbb75b6-4ade-4c9c-bab3-4129053bfe66 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:21.500331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0fbb75b6-4ade-4c9c-bab3-4129053bfe66 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:21.527829 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0fbb75b6-4ade-4c9c-bab3-4129053bfe66 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1214 microversion: 2.1 time: 0.277434 Oct 10 17:08:21.528448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 13/33] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:21 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:22.555005 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-48cfa35c-c643-485f-9c1a-82db9ea968d4 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:22.556747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-48cfa35c-c643-485f-9c1a-82db9ea968d4 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:22.666244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-48cfa35c-c643-485f-9c1a-82db9ea968d4 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:22.687741 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-48cfa35c-c643-485f-9c1a-82db9ea968d4 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1214 microversion: 2.1 time: 0.136950 Oct 10 17:08:22.688591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 21/34] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:22 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:23.298971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ce1fa145-18fc-4e39-90f6-b9cd1ed3984a tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef8b4700>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:23.565041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1432746096", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "710e1b7f-f37c-4711-979b-caac1afb6b90"}], "security_groups": [{"name": "tempest-securitygroup--812803829"}], "key_name": "tempest-keypair-1185581588", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:23.631666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ce1fa145-18fc-4e39-90f6-b9cd1ed3984a tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/881b4e6b-e910-4fb3-b1c9-f5e4fa8e207a" status: 200 len: 351 microversion: 2.1 time: 0.335781 Oct 10 17:08:23.631666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 14/35] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:23 2022] GET /compute/v2.1/os-volumes/881b4e6b-e910-4fb3-b1c9-f5e4fa8e207a => generated 351 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:23.715229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:23.720866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:23.733836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:23.734577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:23.734758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:23.735474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:23.735927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:23.741321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:24.129280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:24.169267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-55562391-bb27-4222-837c-ed088005a9d8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1218 microversion: 2.1 time: 0.457086 Oct 10 17:08:24.173364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 15/36] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:23 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1218 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:24.269256 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] validate_networks() for [('710e1b7f-f37c-4711-979b-caac1afb6b90', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:08:24.601844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1599920243", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0eee5d35-4847-4982-a7a4-935838222131"}], "security_groups": [{"name": "tempest-securitygroup--154001155"}], "key_name": "tempest-keypair-2098437952", "user_data": "}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:24.832797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] validate_networks() for [('0eee5d35-4847-4982-a7a4-935838222131', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:08:25.479774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:08:25.482822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:08:25.483477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:08:25.484075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:08:25.484647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:08:25.494641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.495151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.495717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.496510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.497135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.498514 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.528746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for project 34f584f725354f68b917b45b645b3630. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:08:25.533209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for user b8507de448b6455fb792bda0c949421d and project 34f584f725354f68b917b45b645b3630. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:08:25.536691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:08:25.537973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:08:25.538679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:08:25.539296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:08:25.540229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:08:25.545345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:08:25.548156 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:08:25.550409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.551417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.551973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.552893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.553563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.554117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.578060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for project 18aef1375628417b91f816bccd05d1cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:08:25.583891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for user 8bb27ad53d4a454eb10268ab27ad3258 and project 18aef1375628417b91f816bccd05d1cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:08:25.610156 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:08:25.613331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:08:25.749452 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-724bdb41-6e7a-4b82-9762-7b9f408062c5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.193183 Oct 10 17:08:25.752343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 22/37] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Oct 10 17:08:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 17:08:25.761207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:25.762820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:25.787153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.789212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.789847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.791640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:25.795171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:25.795171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:25.872833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f11bc181-6fa3-457e-9e54-51ded7533f7a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.276935 Oct 10 17:08:25.879035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 16/38] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:08:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 17:08:25.903049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:25.903799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:26.071205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:26.099436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0ae97336-0353-49e7-a6ba-0d34f88de554 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1274 microversion: 2.1 time: 0.345320 Oct 10 17:08:26.102505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:25 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:26.116598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9ed0b391-2909-4d02-b93b-b2f822a100b2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:26.117700 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9ed0b391-2909-4d02-b93b-b2f822a100b2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:26.287783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:26.301258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:26.302872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:26.305230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7bd06e32-0e18-4d4d-87f7-113149707628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1282 microversion: 2.20 time: 0.423711 Oct 10 17:08:26.305810 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 17/40] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:25 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1282 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:26.328516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1b5c7c77-dc29-4a8d-bdd5-06989dd7055a tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef841790>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:26.424998 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9ed0b391-2909-4d02-b93b-b2f822a100b2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:26.428637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1b5c7c77-dc29-4a8d-bdd5-06989dd7055a tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e1dbc353-4804-4a8d-bf99-2d9452ed730c" status: 200 len: 351 microversion: 2.1 time: 0.121379 Oct 10 17:08:26.429612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 18/41] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/os-volumes/e1dbc353-4804-4a8d-bf99-2d9452ed730c => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:26.445135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9ed0b391-2909-4d02-b93b-b2f822a100b2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1238 microversion: 2.1 time: 0.334541 Oct 10 17:08:26.445135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1238 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:26.447112 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0a766d2c-bf0b-4b2d-8d0b-19d811dcc2a2 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef841c10>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:26.540964 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0a766d2c-bf0b-4b2d-8d0b-19d811dcc2a2 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098904 Oct 10 17:08:26.542030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:26.556911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-dd1831b3-756b-465f-a098-b2240769fd5c tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7f9790>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:26.702383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-dd1831b3-756b-465f-a098-b2240769fd5c tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.149281 Oct 10 17:08:26.719605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 25/44] 10.222.0.42 () {58 vars in 1149 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:26.723206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-aab65bcd-29b2-4e51-9e8b-29f7a29bee1e tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef811d30>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:26.953208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-aab65bcd-29b2-4e51-9e8b-29f7a29bee1e tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.233031 Oct 10 17:08:26.958279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 20/45] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:26.970960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8936201f-e07a-417e-ae7b-ad080d3d5686 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7b85e0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.109769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8936201f-e07a-417e-ae7b-ad080d3d5686 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142792 Oct 10 17:08:27.121786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 26/46] 10.222.0.42 () {58 vars in 1167 bytes} [Mon Oct 10 17:08:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:27.127102 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.127729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:27.128713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0bfe7f23-3739-44a4-96b3-e02f82ac08da tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7f9790>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.134389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:27.135567 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:27.135947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:27.142540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:27.142540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:27.142540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:27.286361 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:27.296331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9d40dc4d-1724-421b-acec-383115f9ea84 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1272 microversion: 2.1 time: 0.173322 Oct 10 17:08:27.299273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 21/47] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:27.320318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0bfe7f23-3739-44a4-96b3-e02f82ac08da tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.197294 Oct 10 17:08:27.321528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 27/48] 10.222.0.42 () {58 vars in 1170 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:27.332781 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.333391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:27.339050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e7918b23-e5ee-448f-89d5-597de5bdf677 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7b8160>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.422368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:27.437968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:27.440263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:27.441669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8f09a906-5547-43ca-add1-31d771f83c90 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1282 microversion: 2.20 time: 0.112869 Oct 10 17:08:27.442353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 22/49] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:27.470430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-93e957c8-aca7-496b-ba9f-f1acf74cebcc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.471044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-93e957c8-aca7-496b-ba9f-f1acf74cebcc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:27.591473 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e7918b23-e5ee-448f-89d5-597de5bdf677 tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.258188 Oct 10 17:08:27.592729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 28/50] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:27.606412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b404f319-a95e-44b9-851e-1c31849720ec tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7bfdc0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.713871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b404f319-a95e-44b9-851e-1c31849720ec tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.111489 Oct 10 17:08:27.714470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 29/51] 10.222.0.42 () {58 vars in 1188 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:08:27.729097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a6dd11fa-92c0-400c-9697-c45ccb2b69fb tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] Calling method '.version_select at 0x7f34ef7eed30>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:27.829797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-93e957c8-aca7-496b-ba9f-f1acf74cebcc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:27.835042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a6dd11fa-92c0-400c-9697-c45ccb2b69fb tempest-VolumesTestJSON-1990463803 tempest-VolumesTestJSON-1990463803-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.110485 Oct 10 17:08:27.835754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 30/52] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:27.839374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-93e957c8-aca7-496b-ba9f-f1acf74cebcc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1238 microversion: 2.1 time: 0.376673 Oct 10 17:08:27.849031 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 23/53] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:27 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1238 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:28.328341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:28.328854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:28.335033 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.335515 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.335955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.336783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.337354 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.338293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.469427 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:28.470038 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:28.476304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.476793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.477291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.477992 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.478477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.478910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.514731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:28.522888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-58068302-b9af-44fd-afad-f7fe49216e6f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.198465 Oct 10 17:08:28.523613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 31/54] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:28 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:28.544696 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:28.553387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:28.554984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:28.556302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bb5d5330-97ae-44d0-81e9-b49ad574ccb1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1286 microversion: 2.20 time: 0.090903 Oct 10 17:08:28.556966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 24/55] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:28 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:28.869947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:28.871151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:28.893093 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.895347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.897853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.898760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:28.900506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:28.901092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:28.972323 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:28.980285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-aff0223c-4129-44fc-ae0e-dc3775573edf tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1242 microversion: 2.1 time: 0.121176 Oct 10 17:08:28.980847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 32/56] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:28 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:29.546675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:29.548709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:29.553247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:29.553731 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:29.554191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:29.554885 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:29.555584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:29.556106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:29.582863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:29.583925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:29.601705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:29.602888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:29.603522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:29.604672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:29.605299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:29.606091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:29.704907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:29.713031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:29.714658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:29.715601 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a0a0c06d-f87c-4a85-9d9f-7c7c585d8322 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.137264 Oct 10 17:08:29.720697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 33/57] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:29 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:29.915159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:29.930827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6a883ac0-c666-4950-9ba7-6ad335acaea0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.387788 Oct 10 17:08:29.934309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 25/58] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:29 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:30.003727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:30.005026 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:30.011353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.012104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.012697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.014569 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.015195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.015815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.101367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:30.111078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e0615d71-aaa7-4830-9370-fd4c3d525d34 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1290 microversion: 2.1 time: 0.110985 Oct 10 17:08:30.111822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 34/59] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:29 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:30.749394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:30.750018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:30.760756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.764103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.764982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.768254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.769298 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.771421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.920768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:30.925629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfdb893-395c-451e-bfe6-85699f6b0b73", "tag": "a87e859d-2bf5-4368-8fce-e83d1c2d2dd8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:30.933321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:30.936112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:30.938422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8657e1d5-eea1-4e75-bec5-5c55f17fde9c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.193461 Oct 10 17:08:30.939283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 35/60] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:30 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:30.944829 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.945342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.958219 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.959241 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:30.959881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:30.979041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.979610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.980086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.981668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.982144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.982578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:30.990036 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Creating event network-changed:a87e859d-2bf5-4368-8fce-e83d1c2d2dd8 for instance bcfdb893-395c-451e-bfe6-85699f6b0b73 on hv-cinder-83454 Oct 10 17:08:30.991209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119264) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 17:08:30.991508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b401105b-a777-4e1c-9c72-a1a02a92cc1e req-bd0f069a-43ac-4196-837f-3eeeae1cf945 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119264) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 17:08:30.992835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:30.993471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:30.998854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:31.000002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:31.000971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:31.001630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:31.021899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.compute.rpcapi [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 17:08:31.022900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] Releasing lock "compute-rpcapi-router" {{(pid=119264) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 17:08:31.046167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f21ba8ca-7a1e-4bb9-be69-ad1fd6053466 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.531804 Oct 10 17:08:31.048067 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 26/61] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:31.135504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:31.137145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:31.143394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:31.143995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:31.144454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:31.145285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:31.145596 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:31.146056 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:31.216887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:31.225741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bfb7b529-8233-44a0-8f23-1017276e6b1f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1290 microversion: 2.1 time: 0.094665 Oct 10 17:08:31.232678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 27/62] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:31 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:31.313829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:31.321765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-11e8d490-11b0-4bbc-b65d-ef5b241238f7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.371120 Oct 10 17:08:31.337840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 36/63] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:30 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:31.970271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:31.970271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:31.976705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:31.977375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:31.977807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:31.979126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:31.980075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:31.980508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:32.051927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:32.080369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:32.080369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:32.080369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b7f46297-f09f-4c53-9c7f-4d2889f989ad tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.101862 Oct 10 17:08:32.080637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 28/64] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:31 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:32.249530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:32.250137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:32.256329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:32.256816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:32.257257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:32.257984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:32.258444 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:32.258849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:32.330697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:32.341730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-065bb7f9-b36f-4a4c-a999-93baef272e41 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.095958 Oct 10 17:08:32.342388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 37/65] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:32 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:32.346317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:32.347017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:32.353603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:32.354298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:32.354826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:32.355840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:32.356340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:32.356757 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:32.562233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:32.571021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b69a320e-2d6f-4ad5-897b-0632077b439b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.229253 Oct 10 17:08:32.575061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 29/66] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:32 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:33.091165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:33.091997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:33.101012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.101951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.102058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.102911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.103414 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.103825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.167753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:33.175861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:33.177403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:33.183659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-08df5d04-88e1-406e-bfc8-71c224db23d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.092002 Oct 10 17:08:33.183659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 38/67] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:33 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:33.372275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:33.372275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:33.374123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.374810 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.375397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.376288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.376741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.377171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.444732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:33.452884 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-89def6e0-12d9-4841-b0bb-2408f6ed7b8f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.091736 Oct 10 17:08:33.456944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 30/68] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:33 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:33.595617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:33.596301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:33.602577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.603057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.603690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.604555 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:33.605162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:33.605722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:33.771518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:33.779406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1694d003-6dfe-46f0-b347-d7b11f6fcbe2 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.188639 Oct 10 17:08:33.780545 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 39/69] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:33 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:34.204603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:34.205730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:34.213887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.214768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.215494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:34.216533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.217214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.217885 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:34.295715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:34.304514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:34.305963 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:34.307106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1144ebfd-aa2e-4a04-9f1e-3c6524861026 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.106426 Oct 10 17:08:34.308210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 31/70] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:34 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:34.477057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:34.478274 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:34.486699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.487434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.488362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:34.489296 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.490010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.490757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:34.560255 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:34.569503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-72f3dac9-c24c-4e5f-8ec4-9c3da254b5d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.096631 Oct 10 17:08:34.570365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 40/71] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:34 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:34.805631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:34.806170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:34.812740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.813229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.813663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:34.814353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:34.814800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:34.815221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:35.011034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:35.021188 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2f411baf-d776-4f31-8759-97dcef03f6cc tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.219079 Oct 10 17:08:35.022312 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 32/72] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:34 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:35.338499 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:35.340544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:35.354134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:35.356064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:35.358047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:35.358940 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:35.360827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:35.361702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:35.444986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:35.457254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:35.458709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:35.459829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f51ea743-c232-4116-863d-af15c2cad24f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.125502 Oct 10 17:08:35.460727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 41/73] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:35 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:35.597892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:35.598503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:35.639686 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:35.640283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:35.640750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:35.641471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:35.641934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:35.642364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:35.767815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:35.780501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7f9c0fb3-4ac8-4582-ad27-5d058a2ae13b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.185732 Oct 10 17:08:35.784474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 33/74] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:35 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:36.045548 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:36.046197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:36.048230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:36.053488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.053979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.054460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.055314 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.055779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.056282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.263738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:36.272474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d7993d3a-c098-4843-aacd-504b8a4f543e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.230582 Oct 10 17:08:36.272723 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 42/75] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:36 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:36.490509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:36.491127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:36.497817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.498568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.499833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.501022 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.501682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.502339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.596407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:36.608253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:36.609888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:36.616208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-691becba-cb44-4cb9-b5e2-c47351cfcc05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.132200 Oct 10 17:08:36.620657 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 34/76] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:36 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:36.804625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:36.805583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:36.807365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=20 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:36.816721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.816721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.816721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.816721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:36.817076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:36.817076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:36.909942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:36.927600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9a29e070-5871-4f50-995e-a6cb37d57aa0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.116979 Oct 10 17:08:36.927600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 43/77] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:36 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:37.296384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:37.297328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:37.305244 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.305892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.306976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:37.307784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.308389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.309041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:37.501981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:37.510888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1a846a70-a80a-41e3-a791-7a9bf3787c82 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.219337 Oct 10 17:08:37.511455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 35/78] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:37 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:37.641485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:37.642028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:37.648269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.648756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.649172 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:37.649859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.650484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.651047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:37.735747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:37.745707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:37.747445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:37.748593 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4c9bb3bf-a2cb-4aa2-9506-fe4bdc6c83bb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.111164 Oct 10 17:08:37.749487 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 44/79] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:37 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:37.941723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:37.943122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:37.945371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=20 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:37.950476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.951140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.952593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:37.952593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:37.953165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:37.953594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:38.090999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:38.099698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-80e1b3a1-df5c-494c-b5a8-e3065b472fc5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.162025 Oct 10 17:08:38.104502 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 36/80] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:37 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:38.536709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:38.538085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:38.545666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:38.546253 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:38.546934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:38.547696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:38.548530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:38.549150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:38.777191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:38.778633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:38.799288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:38.799966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:38.800852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:38.801804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:38.802654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:38.803132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:38.846629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:38.869873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4905121c-8fd4-4296-998b-3a73b1a7ba12 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.338296 Oct 10 17:08:38.871627 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 45/81] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:38 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:38.918646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:38.935221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:38.938793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:38.938793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-de49631d-bda6-4cc8-9d8f-212df13c2961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.165178 Oct 10 17:08:38.938793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 37/82] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:38 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:39.129332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:39.130897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:39.137814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:39.138562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:39.139151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:39.140012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:39.140484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:39.140913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:39.145099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:39.208857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:39.216863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-28b7eb1b-0903-4836-a433-128fbdde0e6a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.091644 Oct 10 17:08:39.217672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 46/83] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:39 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:39.898630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:39.901162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:39.910918 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:39.911699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:39.912608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:39.913533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:39.919730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:39.919730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:39.949413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:39.968712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:39.969100 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:39.998902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:40.000408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:40.003157 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:40.007249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:40.008213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:40.015532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:40.130037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:40.142657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:40.142657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:40.148299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d33ca143-8300-468b-87dc-0692193ef5cb tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.187154 Oct 10 17:08:40.151795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 47/84] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:39 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:40.241170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:40.242151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:40.257100 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:40.257941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:40.258743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:40.261009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:40.261693 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:40.264406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:40.278857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:40.290201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8c76a42c-69d4-42b0-820d-ef6048df5d8e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.396899 Oct 10 17:08:40.292981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 38/85] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:39 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:40.379419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:40.391188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e038ee87-db41-44d5-88f0-460f1dd10452 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1298 microversion: 2.1 time: 0.153658 Oct 10 17:08:40.393828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 48/86] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:40 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:41.180852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:41.182055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:41.188371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:41.201472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.202164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.203767 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.204742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.207259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.207988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.334582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:41.334582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:41.334582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.334582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.335971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.336972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.336972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.337224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.343837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:41.353832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:41.355740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:41.357164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-056b323b-3c27-47d4-bae6-f4398b77eb4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.181126 Oct 10 17:08:41.358273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 39/87] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:41 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:41.417286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:41.417923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:41.426543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.427079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.427705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.428446 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:41.429075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:41.429651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:41.530490 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:41.538693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-63a3d85c-2fc3-4c20-b391-ecc49abca597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1308 microversion: 2.1 time: 0.126459 Oct 10 17:08:41.541993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 40/88] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:41 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:41.579007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:41.586975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-55c5cfa8-5b6c-4aed-920d-9b8764e5b27f tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.275965 Oct 10 17:08:41.588164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 49/89] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:41 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:42.384327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:42.384932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:42.392503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.392993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.393430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.394124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.394571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.394985 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.512811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:42.526297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:42.527806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:42.528914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9353a2ed-5e46-4896-a18c-598f1e1254a2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.148604 Oct 10 17:08:42.529472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 41/90] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:42 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:42.582371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:42.582371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:42.586827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.588305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.588989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.589889 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.590543 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.590970 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.610563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:42.611365 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:42.619184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.620609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.621239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.622249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:42.623105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:42.623545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:42.955055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:42.958703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:42.968750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-92985ccd-8ec8-44d3-811d-137e176da8cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.396734 Oct 10 17:08:42.968750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 50/91] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:42 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:42.968900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ef381d1b-ea65-47d6-b1c7-96d87adbbdc8 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.362197 Oct 10 17:08:42.972316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 42/92] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:42 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:43.554823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:43.555476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:43.562160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:43.570296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:43.570296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:43.570296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:43.570296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:43.570834 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:43.656367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:43.656367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:43.659013 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:43.660719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d4319264-1915-48f3-9a07-b3228f0062f2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1278 microversion: 2.20 time: 0.109873 Oct 10 17:08:43.661424 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 43/93] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:43 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:43.684970 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11741bc9-1727-45fc-9786-80d9a5e3d9f8 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Action: 'create', calling method: .version_select at 0x7f34ef819820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-307040150", "metadata": {"Type": "work"}}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11741bc9-1727-45fc-9786-80d9a5e3d9f8 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 121 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:43.688449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-307040150", "metadata": {"Type": "work"}}} Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:43.689668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-307040150', 'metadata': {'Type': 'work'}}}} Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise error Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi '#$%' Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.690362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 17:08:43.691875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 17:08:43.695016 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 17:08:43.695016 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.695016 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11741bc9-1727-45fc-9786-80d9a5e3d9f8 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.696372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-11741bc9-1727-45fc-9786-80d9a5e3d9f8 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.288132 Oct 10 17:08:43.697490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 51/94] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 10 17:08:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:08:43.707622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5ad2a436-fe97-4ed2-9bb2-d462179dd2cb tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Action: 'create', calling method: .version_select at 0x7f34ef81f790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2096806790", "metadata": {"Type": "work"}}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5ad2a436-fe97-4ed2-9bb2-d462179dd2cb tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 120 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:08:43.712526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2096806790", "metadata": {"Type": "work"}}} Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: Oct 10 17:08:43.717321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2096806790', 'metadata': {'Type': 'work'}}}} Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise error Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi '0' Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.717984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 17:08:43.719085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 17:08:43.720447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 17:08:43.720447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.720447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5ad2a436-fe97-4ed2-9bb2-d462179dd2cb tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.720447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5ad2a436-fe97-4ed2-9bb2-d462179dd2cb tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011465 Oct 10 17:08:43.720447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 44/95] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 10 17:08:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:08:43.725312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-53f4b7df-0574-4852-ab8a-a5b5905e8819 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Action: 'create', calling method: .version_select at 0x7f34ef7f93a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407108703", "metadata": {"Type": "work"}}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-53f4b7df-0574-4852-ab8a-a5b5905e8819 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 118 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:43.730981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407108703", "metadata": {"Type": "work"}}} Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:43.739276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-407108703', 'metadata': {'Type': 'work'}}}} Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise error Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi '' Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.739985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 17:08:43.741285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 17:08:43.742250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 17:08:43.742250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.742250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-53f4b7df-0574-4852-ab8a-a5b5905e8819 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.742250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-53f4b7df-0574-4852-ab8a-a5b5905e8819 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011954 Oct 10 17:08:43.742250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 52/96] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 10 17:08:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:08:43.747854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-089f03d6-9e6f-4368-8b38-b2920f68f40a tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Calling method '.version_select at 0x7f34ef811940>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:43.781281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-089f03d6-9e6f-4368-8b38-b2920f68f40a tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] HTTP exception thrown: Volume tempest-invalid-409957871 could not be found. Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-089f03d6-9e6f-4368-8b38-b2920f68f40a tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-409957871 HTTP/1.1 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:08:43.783389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Volume tempest-invalid-409957871 could not be found. Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'tempest-invalid-409957871'} Oct 10 17:08:43.784742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-409957871 could not be found. (HTTP 404) (Request-ID: req-e45bab66-a36c-43a8-8e21-233aa85d0a9b) Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.790039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:43.791901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-409957871 could not be found. Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:43.793288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-409957871 could not be found. Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-409957871 could not be found. Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-089f03d6-9e6f-4368-8b38-b2920f68f40a tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 404 to user: Volume tempest-invalid-409957871 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-089f03d6-9e6f-4368-8b38-b2920f68f40a tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-409957871" status: 404 len: 98 microversion: 2.1 time: 0.042762 Oct 10 17:08:43.794641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 45/97] 10.222.0.42 () {58 vars in 1215 bytes} [Mon Oct 10 17:08:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-409957871 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 17:08:43.796144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e206c0f4-23d2-4fa6-ad10-13023da1bbc1 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003995 Oct 10 17:08:43.796630 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 53/98] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Oct 10 17:08:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 17:08:43.804718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-658f5d1d-f56a-4dd4-9463-34ecbe3632b9 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003613 Oct 10 17:08:43.805197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1137 bytes} [Mon Oct 10 17:08:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 10 17:08:43.813721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7bf1dbec-1dc0-4d6d-b0db-deda1e58e7e6 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Calling method '.version_select at 0x7f34ef7c20d0>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:43.845775 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-7bf1dbec-1dc0-4d6d-b0db-deda1e58e7e6 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] HTTP exception thrown: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7bf1dbec-1dc0-4d6d-b0db-deda1e58e7e6 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/os-volumes/61bfb381-4708-4a92-97fa-996ee887c546 HTTP/1.1 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:08:43.848462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '61bfb381-4708-4a92-97fa-996ee887c546'} Oct 10 17:08:43.850811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. (HTTP 404) (Request-ID: req-9649cf9f-8a2c-48eb-a889-e2ca2335f996) Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.851484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 17:08:43.852462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 17:08:43.854872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7bf1dbec-1dc0-4d6d-b0db-deda1e58e7e6 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 404 to user: Volume 61bfb381-4708-4a92-97fa-996ee887c546 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7bf1dbec-1dc0-4d6d-b0db-deda1e58e7e6 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/61bfb381-4708-4a92-97fa-996ee887c546" status: 404 len: 109 microversion: 2.1 time: 0.040008 Oct 10 17:08:43.855829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 54/100] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:08:43 2022] DELETE /compute/v2.1/os-volumes/61bfb381-4708-4a92-97fa-996ee887c546 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:43.865263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-928e298a-e478-498a-a638-f50af85f8442 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Calling method '.version_select at 0x7f34ef841e50>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:43.893712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-928e298a-e478-498a-a638-f50af85f8442 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] HTTP exception thrown: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-928e298a-e478-498a-a638-f50af85f8442 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Request method failure captured: Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/os-volumes/48e93fe9-68f2-447a-89f9-b963ad10ed75 HTTP/1.1 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGbULgv-GheReGrVzCL4qNROVNhRA0wyrD98Cg3yL8W6VlGo5ZEKlR5eCq5VgJDNp05cLxa9kH304Vn9nR2wMFrtpgaU_9CP0p2vckjm39hNHOvAHunBxt24MeP6O6b5Zh-O3qxSELdFb5C9pgdj1Kd4He5PLeA17WcXMeE_R5qWhA Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:08:43.895880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ca52f64f7fe4e6fa89f63a8ff968751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ca52f64f7fe4e6fa89f63a8ff968751"}]}] Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 3ca52f64f7fe4e6fa89f63a8ff968751 Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesNegativeTest-1974812222 Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 56dd0b4a466f44c986babddcf9a63b43 Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesNegativeTest-1974812222-project Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '48e93fe9-68f2-447a-89f9-b963ad10ed75'} Oct 10 17:08:43.897235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. (HTTP 404) (Request-ID: req-7c3731f0-1fb2-4ba0-868b-a0e63f00b50a) Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.898098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 17:08:43.900609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 17:08:43.901804 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. Oct 10 17:08:43.902749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:08:43.905198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-928e298a-e478-498a-a638-f50af85f8442 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] Returning 404 to user: Volume 48e93fe9-68f2-447a-89f9-b963ad10ed75 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:08:43.916313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-928e298a-e478-498a-a638-f50af85f8442 tempest-VolumesNegativeTest-1974812222 tempest-VolumesNegativeTest-1974812222-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/48e93fe9-68f2-447a-89f9-b963ad10ed75" status: 404 len: 109 microversion: 2.1 time: 0.048913 Oct 10 17:08:43.916313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 10 17:08:43 2022] GET /compute/v2.1/os-volumes/48e93fe9-68f2-447a-89f9-b963ad10ed75 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:43.990137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:43.990671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:43.997466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:43.997958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:43.998394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:43.999425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:43.999884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:44.000329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:44.002203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:44.003038 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:44.010089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:44.010583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:44.011018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:44.011708 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:44.012184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:44.012603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:44.372731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:44.383870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c295d282-e79a-4c65-92eb-5699c06aefae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.397941 Oct 10 17:08:44.386665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 55/102] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:43 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:44.393937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:44.413256 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e9940dbe-78f9-421f-aca8-949b8f1e28e5 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.416013 Oct 10 17:08:44.413872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 48/103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:43 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:44.687245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:44.687849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:44.691466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:44.695310 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:44.698076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:44.698076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:44.698076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:44.698314 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:44.698809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:44.848367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:44.858773 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:44.870616 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:44.877941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9d4ff04b-deb4-4ba6-b839-a781f9de3fd1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1334 microversion: 2.20 time: 0.194959 Oct 10 17:08:44.879401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 56/104] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:44 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:45.417616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:45.428988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:45.428988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:45.428988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.429578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.430250 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.437623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:45.438242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:45.445083 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.445479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.446550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.447659 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.452174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.457182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.457182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.457182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.457182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.727277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:45.736606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-eaaad8aa-f905-4f7b-a213-a010b273f4df tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.326606 Oct 10 17:08:45.737714 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:45 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:45.746715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:45.757107 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bf74a125-6558-44f9-b41b-67f2348e3d9b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.323914 Oct 10 17:08:45.758130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 57/106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:45 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:45.905447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:45.906032 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:45.912613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.913092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.913523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.914201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:45.914824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:45.915242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:45.986953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:45.997030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:45.998504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:45.999638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c66aa0a0-2049-47f8-ac38-4f931f7c3f05 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1342 microversion: 2.20 time: 0.098020 Oct 10 17:08:46.000369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 50/107] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:45 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:08:46.171836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83890954-0bab-4582-a1a0-46ba1a3d846e", "tag": "ee17d066-205b-40da-b2ab-8a810dbe5020"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:46.197937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.199799 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.200396 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.225766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Creating event network-changed:ee17d066-205b-40da-b2ab-8a810dbe5020 for instance 83890954-0bab-4582-a1a0-46ba1a3d846e on hv-cinder-83454 Oct 10 17:08:46.226641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 17:08:46.227226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c6b554a6-006a-419d-ab7d-3f6fbf9b1ea4 req-28b35be9-4cf5-4f5d-a3ee-7dc5edc323c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 17:08:46.228968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.229519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.230126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.244704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.249944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.252715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.277527 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.compute.rpcapi [None req-816040a4-54e8-4627-9577-771d18848753 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 17:08:46.278420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-816040a4-54e8-4627-9577-771d18848753 None None] Releasing lock "compute-rpcapi-router" {{(pid=119263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 17:08:46.300643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-816040a4-54e8-4627-9577-771d18848753 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242947 Oct 10 17:08:46.305328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 58/108] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:46.763953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:46.765241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:46.771904 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.772761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.773266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.774054 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.774574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.775689 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.788888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:46.789965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:46.802510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.803065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.808841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:46.809593 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:46.810063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:46.810496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:47.076738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:47.093244 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b8423134-19f4-4fc2-8afe-e7d26306b681 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.334209 Oct 10 17:08:47.094818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:47.095033 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 51/109] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:46 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:47.100774 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:47.101588 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:47.107976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:47.108701 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:47.109026 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-03a16cf1-5730-4b5d-b21c-e27629dd0367 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.324520 Oct 10 17:08:47.109702 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:47.110729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:47.110881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 59/110] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:46 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:47.112257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:47.112897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:47.181575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:47.189710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:47.191468 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:47.192610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-11d5d24b-c914-41fa-80e6-0e3b17612e2c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1342 microversion: 2.20 time: 0.096489 Oct 10 17:08:47.193168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 52/111] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:47 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:48.121659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:48.122270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:48.134950 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:48.136609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:48.136841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.137295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.137717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.138490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.138881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.139305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.153368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.156325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.159695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.159695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.159695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.160593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.487525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:48.497870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bb8be128-6921-4c5f-bbf1-bccd731dab9f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.379921 Oct 10 17:08:48.499060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 60/112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:48 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:48.504301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:48.505438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:48.514124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.514835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.515221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:48.515732 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.516696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:48.517566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:48.518213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:48.530667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-738d5c6c-0cf6-48e9-967b-3f4b1a195ac7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.400810 Oct 10 17:08:48.532282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:48 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:48.615689 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:48.625034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:48.626473 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:48.627787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2ec35405-d49c-4544-997b-39c24129a4ee tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1340 microversion: 2.20 time: 0.127539 Oct 10 17:08:48.628906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 61/114] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:48 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1340 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:49.527211 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:49.527790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:49.539380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.539985 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.540449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:49.541157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.541620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.545411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:49.560756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:49.561540 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:49.569275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.570011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.570654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:49.572430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.573093 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.574122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:49.801385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:49.804181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:49.810477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9cd0faf1-d6eb-4a9f-82a9-116690a7498c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.287669 Oct 10 17:08:49.811398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:49 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:49.812888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f4c40167-4a00-42d4-9488-d5c9de54e35a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.258003 Oct 10 17:08:49.816076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 62/116] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:49 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:49.816713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:49.817291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:49.823650 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.825376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.826045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:49.826933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:49.827575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:49.828472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:50.128540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:50.140093 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:50.141828 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:50.143275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-056c2385-95cd-4ed3-8b17-3b8807330edd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.330498 Oct 10 17:08:50.158292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 55/117] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:49 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:50.835583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:50.836230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:50.837604 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:50.838374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:50.842853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:50.843435 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:50.844900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:50.844900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:50.845161 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:50.845738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:50.846222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:50.846704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:50.847130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:50.847847 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:50.851457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:50.851906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:51.046647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:51.050732 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:51.056372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-dae58bea-b88f-48d2-b979-4581770b3917 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.221247 Oct 10 17:08:51.057350 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 56/118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:50 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:51.058940 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6845a54e-9141-4ed8-98e8-5aeaed3ff2d0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.228042 Oct 10 17:08:51.059743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 63/119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:50 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:51.169437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:51.170034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:51.181209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:51.183738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:51.184210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:51.184914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:51.185365 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:51.185785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:51.323552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:51.332665 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:51.334199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:51.335355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7b1e00e4-7f9a-48ea-a9f1-e5c6f8c3faec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.169807 Oct 10 17:08:51.335899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 57/120] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:51 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:52.087224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:52.087687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:52.088755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:52.089082 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:52.101266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.101997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.102550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.103059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.103696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.105092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.106038 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.106346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.107117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.108328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.111721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.111721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.380938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:52.384824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:52.389523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-85055a06-f711-416f-9819-523d9078589a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.308232 Oct 10 17:08:52.390093 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 58/121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:52 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:52.400515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:52.410965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:52.412477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.413179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.413826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.422412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c9d1566a-9650-47b5-ab3f-02615248edee tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.345443 Oct 10 17:08:52.422997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:52 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:52.427133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] Creating event network-changed:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:08:52.437228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:52.437592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-a86f10a0-7997-468e-a33a-2a9b19f28c6e req-07d97da7-d035-4ec5-bd1a-35bec8ddaec7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040113 Oct 10 17:08:52.440318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:52.443373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 59/123] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:52.449707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.450218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.450663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.451416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.452068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.452350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.593577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdb893-395c-451e-bfe6-85699f6b0b73", "name": "network-vif-plugged", "status": "completed", "tag": "a87e859d-2bf5-4368-8fce-e83d1c2d2dd8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:52.614654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:52.615133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:52.615565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:52.639611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] Creating event network-vif-plugged:a87e859d-2bf5-4368-8fce-e83d1c2d2dd8 for instance bcfdb893-395c-451e-bfe6-85699f6b0b73 on hv-cinder-83454 Oct 10 17:08:52.649759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-452a9cd3-e758-4c31-9dc5-ba0d278e134a req-2c005892-bfb3-4d66-904f-f2a8141c903c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204705 Oct 10 17:08:52.650923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 60/124] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:52.811889 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:52.822825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:52.824605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:52.826174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a99f162c-76af-41fa-aa00-07d8f43b278e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.399897 Oct 10 17:08:52.827334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 65/125] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:52 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:53.415635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:53.416364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:53.427288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.427788 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.428511 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:53.429494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.430406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.431102 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:53.450178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:53.450948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:53.460895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.461408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.462734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:53.463449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.464669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.465482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:53.695259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:53.700930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:53.705408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b8cfc848-5200-416c-a88e-d9dfba5a26e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.294331 Oct 10 17:08:53.706091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 61/126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:53 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:53.730879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8aa96d4a-a6b8-4710-af2d-2b7b579bfdc9 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.285166 Oct 10 17:08:53.731958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 66/127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:53 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:53.854366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:53.855007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:53.862398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.863080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.863790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:53.864707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:53.865311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:53.866404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:54.013192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:54.022169 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:54.023858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:54.025178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0712940b-d559-4f0f-b0f8-8b020a8c97a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.174732 Oct 10 17:08:54.027087 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 62/128] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:53 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:54.732731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:54.734169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:54.740481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:54.740966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:54.741552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:54.744150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:54.744150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:54.744150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:54.747999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:54.763751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:54.764399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:54.771081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:54.771741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:54.772377 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:54.773391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:54.773991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:54.775117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:55.143346 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:55.150909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:55.157752 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-25985c8d-c523-46a6-b785-05f9077d2c89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.429059 Oct 10 17:08:55.158666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 67/129] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:54 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:55.172208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6883f47a-9276-42ab-91a6-e746360fa501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.400408 Oct 10 17:08:55.172208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 63/130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:54 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:55.172208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:55.172208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:55.178125 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:55.178617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:55.179062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:55.179882 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:55.180422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:55.181359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:55.327839 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:55.336960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:55.338471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:55.342584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-85b10a56-501c-463a-9a65-ea5f4ed7d7d4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.178362 Oct 10 17:08:55.342584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 64/131] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:55 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:56.181699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:56.182268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:56.182636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:56.184055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:56.190135 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.192481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.192481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.192481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.192481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.192893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.199228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.199703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.200224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.200952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.201411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.201833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.274613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:56.388144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:56.391665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:56.395814 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-be1c14c4-1458-454c-8c38-b56df735aaa7 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.217214 Oct 10 17:08:56.396406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 65/132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:56 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:56.410982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-452ca57b-6242-4089-a23d-33fd267d0c76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.221741 Oct 10 17:08:56.410982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 68/133] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:56 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:56.411221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:56.411221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:56.411221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.411221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.411520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.411520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:56.411520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:56.411520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:56.543866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:56.552285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:56.553710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:56.554793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-46a2ac2f-04ca-4095-b354-7e1f7889e796 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.157416 Oct 10 17:08:56.555366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 66/134] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:56 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:57.419607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:57.420249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:57.422014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:57.422615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:57.426941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.427433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.427870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.428555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.428651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.429023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.429140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.429443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.429547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.430116 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.430571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.430986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.627111 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:57.631274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:57.635254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-879567e1-c010-4d64-9064-624eb734d264 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1314 microversion: 2.1 time: 0.220232 Oct 10 17:08:57.635817 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 69/135] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:57 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:57.639799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-86ec8ba6-cbff-4e61-b22e-5131996f600f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.221502 Oct 10 17:08:57.640298 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:57.640613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:57 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:57.640897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:57.646578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.647065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.647499 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.648209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:57.648658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:57.649082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:57.775054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:57.783000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:57.784465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:57.785563 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a03854ac-115d-43fd-9ff7-faa10ee3b75b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.148813 Oct 10 17:08:57.786115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 70/137] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:57 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:58.159581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83890954-0bab-4582-a1a0-46ba1a3d846e", "name": "network-vif-plugged", "status": "completed", "tag": "ee17d066-205b-40da-b2ab-8a810dbe5020"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:08:58.169693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.170183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.170597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.182412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] Creating event network-vif-plugged:ee17d066-205b-40da-b2ab-8a810dbe5020 for instance 83890954-0bab-4582-a1a0-46ba1a3d846e on hv-cinder-83454 Oct 10 17:08:58.187650 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-f52938e5-76a3-4438-980b-50c577e6b360 req-79986d8e-326a-4be6-bd13-cd7e2bb700c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031763 Oct 10 17:08:58.188276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 68/138] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:08:58.659456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:58.660080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:58.663240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:58.664017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:58.666001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.666484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.666919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.667603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.668072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.668494 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.669982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.670467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.671997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.671997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.671997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.672408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.865512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:58.871686 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:58.876927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f900ae36-57be-41e2-b9b2-9f781790228a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1501 microversion: 2.1 time: 0.221388 Oct 10 17:08:58.888391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:58 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:08:58.888391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:58.888391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:58.896823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.896823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.896823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.896823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:58.897388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:58.897388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:58.901549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ff6e92c4-d20b-4b4c-bcc2-73fc13efdd3b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.242542 Oct 10 17:08:58.905107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:58 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:08:59.033395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:59.041697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:59.043518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:08:59.044270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e04775d6-ee35-4204-bd5d-6ab6524f8b4b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.165317 Oct 10 17:08:59.045059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 72/141] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:08:58 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:08:59.926372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:08:59.926970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:08:59.933582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:59.934043 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:59.934469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:08:59.935145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:08:59.935586 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:08:59.936003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:00.070226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:00.071474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:00.071921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:00.078619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:00.079349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:00.080221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:00.081360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:00.082110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:00.082679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:00.083356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8be59d44-93fa-4faf-935a-0ca7de9f8807 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.160598 Oct 10 17:09:00.090400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 70/142] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:08:59 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:00.217205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:00.225102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:00.226535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:00.228196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0cfb6370-4e67-4a4f-a9db-4e4e45d60209 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.161286 Oct 10 17:09:00.228750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 73/143] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:00 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:09:01.107465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:01.108104 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:01.114257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:01.114745 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:01.115176 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:01.115855 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:01.116562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:01.116929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:01.242476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:01.250637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-629aaca8-32a0-4e63-b54a-42badc2c5e19 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.147789 Oct 10 17:09:01.251198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 71/144] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:01 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:01.253638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:01.254244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:01.260631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:01.261198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:01.261657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:01.262330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:01.262774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:01.263185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:01.387089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:01.395069 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:01.396640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:01.397743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9c9da893-72bb-4539-8103-46db5001a854 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.148030 Oct 10 17:09:01.398281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 74/145] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:01 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:09:02.274049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:02.275326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:02.281285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.282041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.282666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:02.283514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.283968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.284417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:02.418855 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:02.427101 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:02.427702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:02.442296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b752a2a2-0d40-4231-8df2-8eb21df112fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.164782 Oct 10 17:09:02.442296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 72/146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:02 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:02.442453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.442453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.442453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:02.442453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.442703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.442703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:02.583174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:02.591643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:02.593174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:02.594366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-213458ad-8d1c-4f3c-aedb-02f7a18971dc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.171195 Oct 10 17:09:02.594949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 75/147] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:02 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:02.760908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "665eaeb8-3b34-469f-a435-d65f0a8091dd"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:02.763445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:02.769712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.770196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.770705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:02.771422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:02.771872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:02.772320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:03.464603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:03.465981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:03.472890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:03.473788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:03.475025 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:03.478328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:03.479038 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:03.479703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:03.611337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:03.619018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a17368fe-9bc7-4941-837b-5af759f3f160 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1363 microversion: 2.1 time: 0.159421 Oct 10 17:09:03.619582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:03 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:09:03.624199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:03.624791 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:03.632593 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:03.633085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:03.634025 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:03.634937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:03.635475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:03.635932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:03.773921 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:03.783675 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:03.785173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:03.786305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d6136c49-b682-4543-8d15-d75d60a85b49 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.165586 Oct 10 17:09:03.786830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 77/149] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:03 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:04.218910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "name": "network-vif-plugged", "status": "completed", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:04.228369 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:04.228875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:04.229303 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:04.240116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] Creating event network-vif-plugged:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:09:04.246235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-e305622a-92e8-4047-b04c-31e2a63ad72b req-767215df-c3ca-4de0-80e8-b793285f63b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Oct 10 17:09:04.246836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 78/150] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:09:04.643184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:04.643924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:04.653665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:04.654155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:04.654590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:04.655318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:04.655747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:04.656198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:04.790391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:04.799735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b905e10d-6272-4836-a0f0-d30e09bb41d5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1549 microversion: 2.1 time: 0.160716 Oct 10 17:09:04.800408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 79/151] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:04 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:09:04.822176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:04.824881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:04.831886 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:04.832328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:04.832768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:04.833481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:04.833995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:04.834361 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:04.985620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:04.993953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:04.995505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:04.996733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f8f4c0f8-7b44-460c-84c6-6f0c5ff55420 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1407 microversion: 2.20 time: 0.183417 Oct 10 17:09:04.997364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 80/152] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:04 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:05.002133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:05.002694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:05.008442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:05.009162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:05.009809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:05.012254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:05.012254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:05.012254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:05.151834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2f591690-a46a-44b6-9b96-dd3d9de325c2 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153183 Oct 10 17:09:05.152826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 81/153] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:09:04 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:05.189524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-05a875bf-31fc-4016-9693-969baf17be1a tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "POST /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.433099 Oct 10 17:09:05.191018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 73/154] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:09:02 2022] POST /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73/os-volume_attachments => generated 194 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:06.022611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:06.024130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:06.030956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:06.031698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:06.032711 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:06.033826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:06.034637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:06.035307 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:06.335421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:06.345423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:06.347057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:06.348269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-adc51769-b2c7-4157-9dbc-ca14a8bec6a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1599 microversion: 2.20 time: 0.330096 Oct 10 17:09:06.348816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 82/155] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:06 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1599 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:06.376644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:06.377894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:06.385574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:06.386133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:06.386729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:06.387491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:06.387940 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:06.388540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:06.513238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5ebd7cfc-65c3-47d4-8335-32eeb8c96d4f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142694 Oct 10 17:09:06.513856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 74/156] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Oct 10 17:09:06 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:09:06.721805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83890954-0bab-4582-a1a0-46ba1a3d846e", "tag": "ee17d066-205b-40da-b2ab-8a810dbe5020"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:06.731480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:06.731950 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:06.732481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:06.743471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] Creating event network-changed:ee17d066-205b-40da-b2ab-8a810dbe5020 for instance 83890954-0bab-4582-a1a0-46ba1a3d846e on hv-cinder-83454 Oct 10 17:09:06.748898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-dcc7bf2c-fbd4-4c10-b08f-5f7bfd55b1f5 req-281a78ca-eb88-49c2-b1bf-d826d852a0bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031078 Oct 10 17:09:06.749500 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 83/157] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:08.529908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:08.539979 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:08.540581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:08.541079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:08.554576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] Creating event network-changed:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:09:08.561347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-3f5c5b96-bd73-4bb6-8fcf-f814dc86a223 req-c36b9c0f-8371-4d02-985a-50a923931f96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 Oct 10 17:09:08.563793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 75/158] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:16.416276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:16.417441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:16.419429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=55 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:16.424558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:16.425105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:16.425726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:16.426605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:16.427053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:16.427473 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:16.457937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:09:16.491897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:16.854851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c997c612-b805-458f-a7e5-5c3f6d1a46eb tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 204 len: 0 microversion: 2.1 time: 0.442842 Oct 10 17:09:16.856437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 84/159] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:09:16 2022] DELETE /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:09:16.874642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:16.875380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:16.881733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=54 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:16.890485 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:16.900656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:16.900656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:16.900656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:16.900656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:16.902099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:17.027664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:17.036108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-811f51ea-0e62-402e-bcf8-151de7ce548b tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1553 microversion: 2.1 time: 0.173434 Oct 10 17:09:17.036681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 76/160] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:16 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:18.062153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:18.063092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:18.069507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:18.069991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:18.070417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:18.071105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:18.071567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:18.071960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:18.207057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:18.216629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-58af865f-2b70-4f60-a55f-7da0078eedea tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1553 microversion: 2.1 time: 0.159520 Oct 10 17:09:18.217286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 85/161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:18 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:19.241301 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:19.241922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:19.248738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:19.253777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:19.253777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:19.253777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:19.253777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:19.254107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:19.255052 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:19.380930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:19.389519 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a6de8819-e24c-4a78-a28e-e1c9a4ccf269 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1553 microversion: 2.1 time: 0.152275 Oct 10 17:09:19.390080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 77/162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:19 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:20.413221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:20.413852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:20.419790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:20.420306 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:20.420740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:20.421415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:20.421862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:20.422285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:20.579047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:20.596170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fac9d014-0cb6-4e88-96f8-59d24bca99d3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1553 microversion: 2.1 time: 0.183199 Oct 10 17:09:20.596170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 86/163] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:20 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:20.987181 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdb893-395c-451e-bfe6-85699f6b0b73", "name": "network-vif-deleted", "tag": "a87e859d-2bf5-4368-8fce-e83d1c2d2dd8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:20.999474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:20.999956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:21.000404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:21.015410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] Creating event network-vif-deleted:a87e859d-2bf5-4368-8fce-e83d1c2d2dd8 for instance bcfdb893-395c-451e-bfe6-85699f6b0b73 on hv-cinder-83454 Oct 10 17:09:21.028834 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-f9611778-6c4a-4690-9641-26221891ca41 req-84d6cfdf-6e6a-4b80-b6b8-83847ae8e7e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048783 Oct 10 17:09:21.029949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 78/164] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:21.624349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:21.624946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:21.630916 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:21.631405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:21.631831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:21.632540 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:21.633024 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:21.633929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:21.715907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:21.722547 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef6e4439-7e43-4c3f-955b-3c8585e3c36e tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1511 microversion: 2.1 time: 0.102000 Oct 10 17:09:21.723106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 87/165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:21 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:22.746377 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:22.747089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:22.754080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:22.754939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:22.755537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:22.756659 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:22.757294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:22.757876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:22.841016 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:22.862043 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2f3a5862-79fe-4f2c-8cc4-e57ab0f52501 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1345 microversion: 2.1 time: 0.121162 Oct 10 17:09:22.862757 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 79/166] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:22 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:23.886278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:23.887870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:23.894725 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:23.895274 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:23.895857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:23.896623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:23.897164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:23.897687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:23.929468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:23.930097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:23.930557 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:23.931011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lazy-loading 'fault' on Instance uuid bcfdb893-395c-451e-bfe6-85699f6b0b73 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:09:23.974414 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d39546d0504953a4f9d769db9421a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c633053a92460c8fd6858e66679fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:23.983241 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-82ac763c-795e-402c-8b60-b6dd871b7fd3 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 200 len: 1350 microversion: 2.1 time: 0.102045 Oct 10 17:09:23.983802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 88/167] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:23 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:09:25.008184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:25.008824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:25.016837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:25.017584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:25.018021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:25.018740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:25.019185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:25.019612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:25.050417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] HTTP exception thrown: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Request method failure captured: Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 HTTP/1.1 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGAr3M5RhFJ46Efba43Q80anEs1XyREg0tzA_PApO0P_gb9zay81tWPOHO_JZmicPh8ue6Evvb3sdL2OZ_5Ix5FcFfQ1RCaZDtkIw2L2XJSSVJHDzfc9kTfRzKxPf1k8pBqV2YRDhr3G-BvFaTQCpBSxEZD7OV_FzWs4TSYH6TVxCU Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:09:25.061873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c633053a92460c8fd6858e66679fd3"}]}] Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: f6d39546d0504953a4f9d769db9421a8 Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.063406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'bcfdb893-395c-451e-bfe6-85699f6b0b73'} Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:09:25.064274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.065892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.067193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Returning 404 to user: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:09:25.067193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3e954bc2-341f-4292-ae4f-fc8ea93d7632 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 404 len: 111 microversion: 2.1 time: 0.059606 Oct 10 17:09:25.067193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 80/168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:25 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:09:25.661091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:25.664010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:25.676979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:25.677462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:25.677893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:25.678808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:25.679075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:25.679492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:25.693507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] HTTP exception thrown: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Request method failure captured: Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73/os-volume_attachments HTTP/1.1 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGAr3M5RhFJ46Efba43Q80anEs1XyREg0tzA_PApO0P_gb9zay81tWPOHO_JZmicPh8ue6Evvb3sdL2OZ_5Ix5FcFfQ1RCaZDtkIw2L2XJSSVJHDzfc9kTfRzKxPf1k8pBqV2YRDhr3G-BvFaTQCpBSxEZD7OV_FzWs4TSYH6TVxCU Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:09:25.701550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c633053a92460c8fd6858e66679fd3"}]}] Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: f6d39546d0504953a4f9d769db9421a8 Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.703017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'server_id': 'bcfdb893-395c-451e-bfe6-85699f6b0b73'} Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:09:25.703790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:25.705238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:25.706614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Returning 404 to user: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:09:25.706614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cf4b006c-2245-4b41-9ced-fa721379f1ce tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042294 Oct 10 17:09:25.706614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 89/169] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:09:25 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:09:33.677872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:33.678428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:33.688732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:33.688732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:33.688732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:33.688732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:33.689074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:33.689074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:33.712123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] HTTP exception thrown: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Request method failure captured: Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 HTTP/1.1 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGAr3M5RhFJ46Efba43Q80anEs1XyREg0tzA_PApO0P_gb9zay81tWPOHO_JZmicPh8ue6Evvb3sdL2OZ_5Ix5FcFfQ1RCaZDtkIw2L2XJSSVJHDzfc9kTfRzKxPf1k8pBqV2YRDhr3G-BvFaTQCpBSxEZD7OV_FzWs4TSYH6TVxCU Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:09:33.714535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c633053a92460c8fd6858e66679fd3"}]}] Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: f6d39546d0504953a4f9d769db9421a8 Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.718966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'bcfdb893-395c-451e-bfe6-85699f6b0b73'} Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:09:33.719808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.721524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.723401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Returning 404 to user: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:09:33.723401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-52ac96c1-096b-4d90-97cc-e4d63a0309d0 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 404 len: 111 microversion: 2.1 time: 0.043066 Oct 10 17:09:33.728477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 81/170] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:09:33 2022] DELETE /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:09:33.739286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:33.739899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] [instance: bcfdb893-395c-451e-bfe6-85699f6b0b73] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:33.746966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:33.751070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:33.751070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:33.751521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:33.752588 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:33.753181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] HTTP exception thrown: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Request method failure captured: Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 HTTP/1.1 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGAr3M5RhFJ46Efba43Q80anEs1XyREg0tzA_PApO0P_gb9zay81tWPOHO_JZmicPh8ue6Evvb3sdL2OZ_5Ix5FcFfQ1RCaZDtkIw2L2XJSSVJHDzfc9kTfRzKxPf1k8pBqV2YRDhr3G-BvFaTQCpBSxEZD7OV_FzWs4TSYH6TVxCU Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:09:33.794951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c633053a92460c8fd6858e66679fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c633053a92460c8fd6858e66679fd3"}]}] Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f9c633053a92460c8fd6858e66679fd3 Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-DeleteServersTestJSON-67678011 Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: f6d39546d0504953a4f9d769db9421a8 Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-DeleteServersTestJSON-67678011-project Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.796279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'bcfdb893-395c-451e-bfe6-85699f6b0b73'} Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:09:33.796935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. Oct 10 17:09:33.798080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:09:33.799106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] Returning 404 to user: Instance bcfdb893-395c-451e-bfe6-85699f6b0b73 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:09:33.799106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-11b0da5e-0e19-412f-bb81-264ac7c54922 tempest-DeleteServersTestJSON-67678011 tempest-DeleteServersTestJSON-67678011-project] 10.222.0.42 "GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73" status: 404 len: 111 microversion: 2.1 time: 0.050392 Oct 10 17:09:33.799106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 90/171] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:33 2022] GET /compute/v2.1/servers/bcfdb893-395c-451e-bfe6-85699f6b0b73 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:09:46.270429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=11 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:46.271187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=16 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:46.407253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-739225809", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:46.471828 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] validate_networks() for [('86a27400-3c0a-470b-b156-cfefc1803bb5', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:09:46.848186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:09:46.848676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:09:46.849223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:09:46.849698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:09:46.850235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:09:46.859540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:46.860018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:46.860484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:46.861207 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:46.861658 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:46.862080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:46.881731 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:09:46.885777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for user 1e8d2e4a8a334eea973280b3819219e3 and project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:09:46.897275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:09:46.899579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:09:47.002099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7bb854c7-b585-4f90-b4db-b71ee0768f89 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.736609 Oct 10 17:09:47.002658 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 82/172] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:09:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:09:47.014559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3f9e78b9-364d-4724-91ed-4ddac3f1b868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:47.015078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3f9e78b9-364d-4724-91ed-4ddac3f1b868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:47.017131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:47.017806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:47.069776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3f9e78b9-364d-4724-91ed-4ddac3f1b868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:47.077610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3f9e78b9-364d-4724-91ed-4ddac3f1b868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1221 microversion: 2.1 time: 0.067652 Oct 10 17:09:47.078184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 91/173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:47 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:47.138824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-391912338", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:47.191726 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] validate_networks() for [('86a27400-3c0a-470b-b156-cfefc1803bb5', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:09:47.567633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:09:47.568798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:09:47.569279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:09:47.569689 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:09:47.570105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:09:47.579302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:47.579780 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:47.580286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:47.581028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:47.581469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:47.581897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:47.598967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:09:47.602808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for user 1e8d2e4a8a334eea973280b3819219e3 and project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:09:47.613899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:09:47.616125 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:09:47.770110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e6859208-63a8-4020-a75d-bb12945502f0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.636459 Oct 10 17:09:47.771526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 83/174] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:09:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 17:09:47.793408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a5be6c1e-7beb-4758-874c-fee5461c9d0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:47.794135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a5be6c1e-7beb-4758-874c-fee5461c9d0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:47.877317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a5be6c1e-7beb-4758-874c-fee5461c9d0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:47.887237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a5be6c1e-7beb-4758-874c-fee5461c9d0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1221 microversion: 2.1 time: 0.107836 Oct 10 17:09:47.898926 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 92/175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:47 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:48.912914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:48.917781 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:48.920854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:48.921350 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:48.922004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:48.922707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:48.923167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:48.923593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:49.000057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:49.012049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0e3e3a9e-fdee-4c2f-96f5-9db4279fdfaf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1225 microversion: 2.1 time: 0.103446 Oct 10 17:09:49.012975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 84/176] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:48 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:50.034822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:50.036419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:50.041667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:50.042344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:50.042779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:50.043493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:50.043946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:50.044393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:50.108561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:50.116464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8b28d3ce-9432-4ecd-bce9-5dbb418e63b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1225 microversion: 2.1 time: 0.085356 Oct 10 17:09:50.121670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 93/177] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:50 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:50.207517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:50.208079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:50.214437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:50.214929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:50.215366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:50.216087 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:50.216549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:50.216975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:50.239225 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-556dca47-ba8c-4c2e-ac47-d1f62b141f3d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035614 Oct 10 17:09:50.239786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 85/178] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:09:50 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:51.139516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:51.140051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:51.145876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:51.146349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:51.146777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:51.147454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:51.147904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:51.148371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:51.207780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:51.215143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a3a84942-be22-43f5-8634-d2f7be4248af tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1217 microversion: 2.1 time: 0.079652 Oct 10 17:09:51.215697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 94/179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:51 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:52.241394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:52.242139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:52.252628 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:52.253526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:52.253784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:52.255508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:52.256164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:52.259499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:52.338998 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:52.346812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b2364beb-ff0b-445d-aa06-89cdb74a2260 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1217 microversion: 2.1 time: 0.111652 Oct 10 17:09:52.348145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 86/180] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:52 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:52.382308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:52.386513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:52.398484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:52.403531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:52.404962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:52.405827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:52.406372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:52.407415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:52.442728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c50b9004-52d6-4668-bfb8-57889f9df8d8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/ips" status: 200 len: 151 microversion: 2.20 time: 0.067724 Oct 10 17:09:52.443804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 95/181] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Oct 10 17:09:52 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/ips => generated 151 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:09:53.369171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:53.370622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:53.377574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:53.378064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:53.378488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:53.379179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:53.379621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:53.380089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:53.598811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:53.607363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5b9a229b-cca4-48b4-867e-d503791bb2b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1281 microversion: 2.1 time: 0.241267 Oct 10 17:09:53.611343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 87/182] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:53 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:54.223633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f811965d-74fc-4f77-809a-ac0f58c0681f"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:54.226053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:54.231929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:54.232517 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:54.232956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:54.233647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:54.234115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:54.234538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:54.403786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69da494-0060-4875-9dc0-625701fa03b5", "tag": "37d21674-f89a-4d01-9819-f5ad96f87075"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:54.423826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:54.424364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:54.424826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:54.448409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] Creating event network-changed:37d21674-f89a-4d01-9819-f5ad96f87075 for instance e69da494-0060-4875-9dc0-625701fa03b5 on hv-cinder-83454 Oct 10 17:09:54.454540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-7b76e050-61c6-4565-a5d4-9e3bbdcad886 req-1366b69d-7c10-40ee-b5e5-13f0fef4f6e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055109 Oct 10 17:09:54.455930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 88/183] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:09:54.632243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:54.632941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:54.639647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:54.640240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:54.640733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:54.641775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:54.642304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:54.642725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:54.901795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:54.910246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4632a32b-26ca-486d-8935-4822847004e4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.282330 Oct 10 17:09:54.911355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:54 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:55.091626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:55.092196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:55.098617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.099335 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.099960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.100890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.101532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.102157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.134558 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lazy-loading 'flavor' on Instance uuid 65073136-459b-4282-b371-c7bf0f7144d2 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:09:55.314713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-949fe7a8-5df1-4250-b76b-44b538dfe1e8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.094968 Oct 10 17:09:55.315497 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 96/185] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:09:54 2022] POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments => generated 194 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:09:55.546726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9c95be-f85e-4793-8479-b522932cab7c", "tag": "479a06ae-07fd-4ef7-a1fe-f3e76ecf1536"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:09:55.560559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.564381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.564381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.586474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] Creating event network-changed:479a06ae-07fd-4ef7-a1fe-f3e76ecf1536 for instance 1d9c95be-f85e-4793-8479-b522932cab7c on hv-cinder-83454 Oct 10 17:09:55.593659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-2aeafb5b-0560-4b7e-a343-5f3453645e1e req-d11f3112-4ba6-4608-bacd-adda2080303e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051760 Oct 10 17:09:55.594260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 97/186] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:09:55.780633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-61ef3094-2811-4d03-b698-c3fcb2ea5789 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/action" status: 202 len: 0 microversion: 2.20 time: 0.693320 Oct 10 17:09:55.781217 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 90/187] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 10 17:09:55 2022] POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:09:55.790116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:55.790790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:55.797429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.798764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.798764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.799085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.799536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.799953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.937472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:55.938623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:55.945884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:55.956649 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:55.956771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:55.958334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a50459c5-c016-42c7-aa88-8c09ea820901 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.172511 Oct 10 17:09:55.959406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.959585 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 98/188] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:55 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:55.959805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.962668 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:55.963724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:55.964388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:55.965131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:56.111390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:56.121343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1365958c-9f09-4a67-8879-141ec72c716b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.190066 Oct 10 17:09:56.122004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 91/189] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:55 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:09:56.991130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:56.992422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:56.999204 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:56.999681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:57.000150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:57.000835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:57.001281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:57.001695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:57.147724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:57.148369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:57.155422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:57.155894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:57.156356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:57.157047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:57.157494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:57.157995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:57.256128 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:57.265226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:57.266748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:57.267996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-db69e92d-091a-4f8f-b554-eff281f8652d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.281239 Oct 10 17:09:57.268570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 99/190] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:56 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:57.362349 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:57.370632 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9fbf5929-5900-42c4-8435-d4aba4740b99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.227610 Oct 10 17:09:57.371114 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 92/191] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:57 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:09:58.293728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:58.294777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:58.297724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:58.303219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:58.303699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:58.304157 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:58.304874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:58.305327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:58.305778 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:58.400404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:58.400404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:58.400404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=4 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:58.400404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=12 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:09:58.405594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:58.405594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:58.405594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:58.409528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:58.409528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:58.409528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:58.520275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:58.528871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:58.530865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:58.532058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4122c7ba-98dd-41f0-8ce0-f632dd9f3155 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.242272 Oct 10 17:09:58.532913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 100/192] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:58 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:58.565594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:58.574944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8b9feb56-3290-4b7f-aa21-d6552b60303d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.184286 Oct 10 17:09:58.575510 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 93/193] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:58 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:09:59.558288 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:59.559422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:59.566715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:59.567280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:59.567998 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:59.568607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:59.569162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:59.569648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:59.609579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:09:59.611471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:09:59.625713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:59.628388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:59.628838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:59.632422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:09:59.632897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:09:59.633332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:09:59.786671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:59.796620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:59.798710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:59.800280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-39289e42-8a64-4bac-b2ae-cc3d8be2d9f4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.246456 Oct 10 17:09:59.801353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 101/194] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:09:59 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:09:59.867938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:09:59.876449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-561b7e48-5467-44d5-8b98-0eef884f8b6c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.281360 Oct 10 17:09:59.877011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:09:59 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:00.827595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:00.828227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:00.834824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:00.835308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:00.835725 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:00.845173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:00.845173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:00.845173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:00.899494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:00.900122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:00.907945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:00.908710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:00.909149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:00.909830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:00.914239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:00.914239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:01.056491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:01.068109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:01.069696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:01.071085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-92e6c79d-1e62-4a28-88a7-bcd7b590b628 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.248203 Oct 10 17:10:01.071630 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 102/196] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:00 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:01.113997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:01.126624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-93f82470-96d6-4901-a364-5870c2fed911 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.231154 Oct 10 17:10:01.127210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 95/197] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:00 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:02.097650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:02.098257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:02.107708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:02.107708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:02.107708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:02.107708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:02.108056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:02.108056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:02.162816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:02.165939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:02.176347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:02.176835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:02.177268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:02.177962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:02.188312 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:02.188956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:02.329099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:02.341743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:02.344884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:02.347804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6ff4f559-ceee-40c6-a28a-f2d435580368 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.253411 Oct 10 17:10:02.349946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 103/198] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:02 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:02.398247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:02.409917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b2dd1388-7f22-4776-b541-d8e2cf5815cc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.262544 Oct 10 17:10:02.410902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 96/199] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:02 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:03.284219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69da494-0060-4875-9dc0-625701fa03b5", "name": "network-vif-plugged", "status": "completed", "tag": "37d21674-f89a-4d01-9819-f5ad96f87075"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:03.304018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:03.304766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:03.305989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:03.320786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] Creating event network-vif-plugged:37d21674-f89a-4d01-9819-f5ad96f87075 for instance e69da494-0060-4875-9dc0-625701fa03b5 on hv-cinder-83454 Oct 10 17:10:03.326533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-f5fb334e-6397-43ae-b594-bac257fcc736 req-1eee62a9-74ed-4828-8987-ded8e9f3df22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048372 Oct 10 17:10:03.327636 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 104/200] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:10:03.375415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:03.376059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:03.383645 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:03.385630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:03.386079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:03.387869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:03.394134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:03.395400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:03.434753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:03.435497 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:03.442838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:03.443344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:03.443786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:03.444518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:03.445177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:03.445603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:03.613956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:03.628002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:03.628672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:03.630118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-27891f0d-670c-4b9c-bc3c-16e0c8d14b07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.258635 Oct 10 17:10:03.630857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 97/201] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:03 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:03.670644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:03.684006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-31f7aebd-c52c-42f6-9e4f-6f4834dd1410 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.254367 Oct 10 17:10:03.685267 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 105/202] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:03 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:04.657724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:04.658328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:04.664437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:04.664922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:04.665352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:04.666040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:04.671505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:04.671505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:04.706591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:04.707259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:04.714537 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:04.715034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:04.715471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:04.716198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:04.716653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:04.717620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:04.852214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:04.860522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:04.866736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:04.867575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:04.870161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5bac5499-51dd-4c3a-a9b4-50db37b527ca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.216829 Oct 10 17:10:04.870897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 98/203] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:04 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:04.914313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:04.925028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-49de7f06-15ce-4111-89ac-399d3ad1b7c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.221886 Oct 10 17:10:04.925605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 106/204] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:04 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:05.348421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9c95be-f85e-4793-8479-b522932cab7c", "name": "network-vif-plugged", "status": "completed", "tag": "479a06ae-07fd-4ef7-a1fe-f3e76ecf1536"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:05.359018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.359535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.359971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.384378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] Creating event network-vif-plugged:479a06ae-07fd-4ef7-a1fe-f3e76ecf1536 for instance 1d9c95be-f85e-4793-8479-b522932cab7c on hv-cinder-83454 Oct 10 17:10:05.392111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-5537062c-5029-43dc-b340-0bca172ebfc6 req-6c302bc6-0e8f-4e82-8ab9-3754debf50b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045691 Oct 10 17:10:05.392111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 99/205] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:10:05.449610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:05.450462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.451223 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.452291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.515467 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Going to try to stop instance {{(pid=119263) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 17:10:05.666660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6fe61903-ba70-4d40-a291-83a3b338b2e4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action" status: 202 len: 0 microversion: 2.1 time: 0.226188 Oct 10 17:10:05.667274 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 107/206] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:10:05 2022] POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:10:05.676462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:05.677159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:05.683234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.683729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.684189 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.684881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.685331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.686261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.817506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:05.825759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-df3576af-e46c-4959-8ce7-82a989d39a76 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.154049 Oct 10 17:10:05.826317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 100/207] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:05 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:05.899924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:05.900661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:05.906961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.907456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.907895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.908621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.909072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.909495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.948016 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:05.948878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:05.956245 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.956741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.957176 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:05.957879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:05.958427 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:05.958849 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:06.131602 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:06.135711 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:06.146155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:06.151539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:06.152800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e42fbe13-cd5f-4932-b585-121340d36f4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.257870 Oct 10 17:10:06.153530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 108/208] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:05 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:06.166662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:06.175187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f04ac55c-f47a-4b3a-836f-3930351380c0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.231039 Oct 10 17:10:06.175744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 101/209] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:05 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:06.851203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:06.851808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:06.858395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:06.858881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:06.859312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:06.860004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:06.860493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:06.860902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:06.990537 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:06.999762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-845328bd-e0cd-485c-9ef0-c6467476d229 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.152406 Oct 10 17:10:07.000381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 109/210] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:06 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:07.179356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:07.179962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:07.189133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:07.189937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:07.191073 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:07.192191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:07.193412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:07.194051 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:07.198192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:07.198803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:07.206676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:07.207165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:07.209099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:07.209099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:07.209099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:07.209370 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:07.435083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:07.444227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:07.446002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:07.447185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5977f787-d051-45a0-ad4e-903005348fdd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.272261 Oct 10 17:10:07.447745 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 102/211] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:07 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:07.468685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:07.476262 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7fe9b0c2-c5e7-421c-92ba-5e84e5069d2e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1321 microversion: 2.1 time: 0.282091 Oct 10 17:10:07.476833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 110/212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:07 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:08.024880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:08.025492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:08.032620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.033329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.034075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.034920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.035520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.036116 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.180867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:08.196391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b9172da5-3b7e-46f8-bb22-fc8476d25c07 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.175280 Oct 10 17:10:08.196958 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 103/213] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:08 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:08.474088 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:08.474737 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:08.481557 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.483405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.483876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.484631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.485136 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.485571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.501623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:08.502369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:08.513286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.514716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.516272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.519091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.519643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.521187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.732218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:08.743226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:08.744919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:08.746701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-57873701-e483-47ed-8722-2d1ca5fd07c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.276616 Oct 10 17:10:08.751261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:08.755760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 111/214] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:08 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:08.760160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-10de3b90-5305-43db-ab9d-60953e00a068 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1515 microversion: 2.1 time: 0.264010 Oct 10 17:10:08.760733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 104/215] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:08 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:08.794610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:08.797529 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:08.803463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.803958 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.804461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.805160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:08.805616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:08.806047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:08.829579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'flavor' on Instance uuid 1d9c95be-f85e-4793-8479-b522932cab7c {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:10:09.148062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-51ad9a67-6546-41a7-9365-987c1410e4c3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c/action" status: 200 len: 32 microversion: 2.1 time: 0.357362 Oct 10 17:10:09.148699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 105/216] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:10:08 2022] POST /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:10:09.159320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:09.160388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:09.169075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.170578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.171018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:09.172061 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.172803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.173294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:09.222426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:09.223133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:09.230049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.230765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.231353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:09.232256 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.233436 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.234164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:09.416538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:09.425111 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-19d804d1-a390-47f3-ac31-5072c59feb99 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.270848 Oct 10 17:10:09.425685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 112/217] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:09 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:09.552400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:09.563962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ac171722-58ba-45bf-911b-bf93647a4036 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.346768 Oct 10 17:10:09.578947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 106/218] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:09 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:09.773883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:09.775028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:09.785303 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.789981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.789981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:09.789981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:09.789981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:09.790615 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:10.054947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:10.064151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:10.065590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:10.067207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cc7f4237-9109-463a-b62d-ea6543f43ff0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.297448 Oct 10 17:10:10.067994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 113/219] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:09 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:10.448925 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:10.449539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:10.458959 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:10.469120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:10.469120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:10.469957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:10.470490 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:10.470916 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:10.588901 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:10.589741 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:10.597231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:10.597954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:10.598626 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:10.599264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:10.599714 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:10.604138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:10.722565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:10.734543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4655eb06-95a6-45e0-8345-a4d8813ad221 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.289690 Oct 10 17:10:10.735891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 107/220] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:10 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:10.827681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:10.836546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0906a1cc-171c-476a-9f23-9c052a4ad7d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.251356 Oct 10 17:10:10.837118 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 114/221] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:10 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:11.097446 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:11.098063 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:11.104378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:11.104855 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:11.105319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:11.106003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:11.106445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:11.106857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:11.317035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:11.326002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:11.327510 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:11.328799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2accf229-6238-4940-b298-ffcb9c9d4f8a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.238378 Oct 10 17:10:11.329362 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 108/222] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:11 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:11.764688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:11.765969 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:11.771981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:11.772665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:11.773171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:11.773933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:11.774442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:11.774986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:11.861724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:11.863111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:12.072368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:12.072368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:12.072368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:12.072368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:12.073683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:12.073683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:12.074258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:12.074258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5538309b-f1c3-46df-9833-dfd25946866f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.240891 Oct 10 17:10:12.074258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 115/223] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:11 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:12.283886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:12.297703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-14944760-b741-4f29-beb2-acb0241a17fe tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.440824 Oct 10 17:10:12.298311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 109/224] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:11 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:12.355958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:12.356967 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:12.364786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:12.365557 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:12.366158 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:12.367031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:12.367483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:12.367906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:12.515150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:12.527234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:12.528714 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:12.536758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-089a5810-8a92-4198-8b75-eb47e5c8ab0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.186544 Oct 10 17:10:12.538210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 116/225] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:12 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:13.025444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:13.026971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:13.035389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.035873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.036467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.037154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.037642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.038143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.202147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:13.210497 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-467627ac-c0df-420f-84b8-fa07617d6f17 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.189007 Oct 10 17:10:13.211303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 110/226] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:13 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:13.321867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:13.322475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:13.329308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.329795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.330222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.330908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.331359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.331777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.483942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:13.491591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8604a365-e543-48bc-98b2-6f5db127c608 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.172690 Oct 10 17:10:13.496599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 117/227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:13 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:13.565599 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:13.566688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:13.579479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.580145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.580687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.581507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:13.582273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:13.583043 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:13.777222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:13.785035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:13.798554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:13.798554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fa0a8fc9-78a3-4525-bc5b-2d522e1d5502 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.226437 Oct 10 17:10:13.798554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 111/228] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:13 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:14.237239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:14.238112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:14.247278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.248827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.249541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:14.250712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.251348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.251954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:14.433912 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:14.441893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-42917451-6c19-44c6-bfa3-ca4cb959b173 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.211030 Oct 10 17:10:14.442459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 118/229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:14 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:14.515124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:14.516113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:14.523681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.524404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.525605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:14.526328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.527272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.527812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:14.694937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:14.705674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-34eada1b-4276-4f37-be5c-69216653db77 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.194607 Oct 10 17:10:14.706310 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 112/230] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:14 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:14.819507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:14.820353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:14.837170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.837815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.839505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:14.840404 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:14.841112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:14.841635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:15.031367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:15.042337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:15.042525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:15.044066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-162b1ec3-7233-4002-b7c1-6be54c556dae tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.229008 Oct 10 17:10:15.060460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 119/231] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:14 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:15.463991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:15.464578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:15.470644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:15.471140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:15.471603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:15.472356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:15.472811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:15.473239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:15.638532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:15.651642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8d035c9c-8d9d-40e5-bd74-a96929f8d25a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.191190 Oct 10 17:10:15.654165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 113/232] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:15 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:15.730350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:15.731719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:15.740984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:15.742218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:15.742676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:15.743903 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:15.744692 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:15.744998 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:16.043735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:16.053098 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef95acd7-069f-45c6-a19c-7bc5c5f7fae3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.326970 Oct 10 17:10:16.065604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 120/233] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:15 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:16.071653 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:16.072927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:16.079592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:16.083851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:16.085261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:16.088948 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:16.089676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:16.090334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:16.100167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:16.428436 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:16.439677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:16.441902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:16.443463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4a071ee9-6214-4bcd-a652-46e9a7589a44 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.375953 Oct 10 17:10:16.451783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 114/234] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:16 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:16.684415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:16.685037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:16.707780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:16.711795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:16.711795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:16.711795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:16.711795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:16.712198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:16.985144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:16.994469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4284951c-5025-4bcb-aa32-073aed1e458d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.316136 Oct 10 17:10:16.996436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 121/235] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:16 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:17.093679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:17.094346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:17.101120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:17.103436 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:17.104167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:17.104837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:17.112827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:17.113597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:17.114106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:17.320677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:17.329970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e4ece192-1a9e-4152-8918-b9ccb35ca580 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.240695 Oct 10 17:10:17.331128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 115/236] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:17 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:17.470860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:17.472536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:17.479045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:17.480853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:17.480853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:17.481380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:17.482000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:17.483234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:17.633531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:17.647533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:17.653177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:17.655183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0902868d-3432-445a-b3d9-e7fe4ed30893 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1744 microversion: 2.20 time: 0.188868 Oct 10 17:10:17.655743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 122/237] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:17 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:18.021158 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:18.025076 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:18.032642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.033868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.041030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.042119 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.042958 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.043698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.250106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:18.271456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4d4e05eb-ae34-4646-ad4a-67919cf6b0c5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.253929 Oct 10 17:10:18.273140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:18 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:18.355406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:18.356189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:18.358876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=69 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:18.364371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.365125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.365768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.366662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.367301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.367967 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.681071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:18.681687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:18.688005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.688537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.688967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.689657 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:18.692947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:18.696566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:18.697011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:18.708133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0e5b77fe-e111-4f06-86e3-84254871e75d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.355002 Oct 10 17:10:18.709621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 123/239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:18 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:18.915751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:18.930396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:18.933027 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:18.935583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-020d95c9-d574-4c22-850c-d7a9050bd983 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1744 microversion: 2.20 time: 0.257619 Oct 10 17:10:18.936363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 117/240] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:18 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:19.296460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:19.296788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:19.303063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.303549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.303980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:19.304871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.305329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.305750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:19.520237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:19.535846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-951e6b2a-4b48-407c-ae51-ef086e1da5cd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.243473 Oct 10 17:10:19.539900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 124/241] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:19 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:19.735128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:19.737351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:19.746308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.746730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.747174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:19.749322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.749892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.750205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:19.961135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:19.961734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:19.977879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.978951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.980053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:19.980896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:19.981913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:19.982605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:20.062333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:20.073927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-13d6e38e-37ea-43f6-9f3f-6d9020593dc4 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.343074 Oct 10 17:10:20.088634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 118/242] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:19 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:20.102579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:20.278419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:20.290385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:20.292663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:20.294454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b37dcc96-44da-4c34-a6ca-78cfedb18202 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1744 microversion: 2.20 time: 0.337168 Oct 10 17:10:20.296296 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 125/243] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:19 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1744 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:20.566838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:20.572339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:20.581163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:20.581688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:20.582151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:20.582869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:20.583325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:20.584815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:20.864405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:20.883768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-55919f40-f23a-4d8c-bf4e-16c589757634 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.318931 Oct 10 17:10:20.883893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 119/244] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:20 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:21.099216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:21.100649 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:21.115350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.119077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.119077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:21.122316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.123379 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.124726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:21.331463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:21.332092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:21.350401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.351157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.351840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:21.353385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.354126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.354854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:21.396460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:21.407344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-da5670d3-015e-42ea-9c0c-bbb4cdddf31a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.312343 Oct 10 17:10:21.408544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 126/245] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:21 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:21.686979 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:21.724445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:21.737886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:21.740744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-87cb2d11-a1d6-46e7-85a6-a403b4dd08e8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.412893 Oct 10 17:10:21.741351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 120/246] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:21 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:21.912321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:21.913030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:21.926719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.927312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.928070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:21.928946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:21.929581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:21.930166 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:22.320599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:22.346470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8041e868-c87c-4e92-b4a3-e8707a529158 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.440349 Oct 10 17:10:22.347386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 127/247] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:21 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:22.433107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:22.434609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:22.441229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:22.442039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:22.445881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:22.446899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:22.447577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:22.450159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:22.771210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:22.771924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:22.785242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:22.797709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:22.798382 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:22.806929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:22.807931 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:22.809197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a2ce3b04-d250-48d9-9010-5b152ab8fc93 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.382090 Oct 10 17:10:22.814915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 121/248] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:22 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:22.815351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:22.816333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.135203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:23.152906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:23.156541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:23.158081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2213d693-69b7-458e-b0e1-821c723a7ae6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.392469 Oct 10 17:10:23.180605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 128/249] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:22 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:23.374774 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:23.375909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:23.408616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:23.409564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:23.410263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.416307 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:23.417273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:23.418892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.660506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:23.670478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-144b103a-3d01-46ed-996e-5f73f21cea20 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.300636 Oct 10 17:10:23.672835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 122/250] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:23 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:23.845780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:23.846993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:23.859051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:23.860821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:23.861269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.861994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:23.862453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:23.862880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.900368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "name": "network-vif-plugged", "status": "completed", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:23.925105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:23.926214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:23.928392 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:23.958630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] Creating event network-vif-plugged:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:10:23.969040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-3fb65b1d-01fc-4971-971b-cf5545935d6c req-4434d0d4-2d5e-448c-8aa4-707a51c6089a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072139 Oct 10 17:10:23.973902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 123/251] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:10:24.192200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:24.246474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:24.246474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:24.246474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:24.246474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:24.247230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:24.247230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:24.247230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:24.309845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:24.322955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5fabf2e8-1794-4596-9b2c-e1ba689c6ec5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.482794 Oct 10 17:10:24.341503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 129/252] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:23 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:24.570017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:24.582444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:24.585264 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:24.588718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ceea38cf-9d4f-41b7-9b71-76367d1bea27 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.402358 Oct 10 17:10:24.589296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 124/253] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:24 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:24.695986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:24.696897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:24.703847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:24.704733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:24.705343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:24.706488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:24.707105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:24.707684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:24.985101 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:24.994269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e1e086a1-adba-439a-b2f4-1b1def3cfd0f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.302154 Oct 10 17:10:25.012728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 130/254] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:24 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:25.354917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:25.356435 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:25.364146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:25.365062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:25.365709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:25.366642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:25.367605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:25.368359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:25.559448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:25.574061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7838de2c-45a3-4f8e-9e3c-28e87fb47a47 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.224332 Oct 10 17:10:25.588414 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:25 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:25.618078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:25.619936 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:25.628169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:25.630232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:25.632262 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:25.633256 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:25.633960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:25.634580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:25.836402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:25.848867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:25.850926 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:25.852359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d33bd953-e132-4a17-a14c-b864c5335db4 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.240419 Oct 10 17:10:25.865376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 131/256] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:25 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:26.036188 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:26.037215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:26.044253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.046058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.047160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.049289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.050017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.051312 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.296012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:26.308469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-776d8410-ed07-4d96-92dd-593c8821f17b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.284009 Oct 10 17:10:26.309519 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 126/257] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:26 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:26.602863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:26.604217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:26.617290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.618457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.619088 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.620165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.620777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.621509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.813441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:26.822796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ba5a5921-017e-4f64-a465-f157100fd654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1724 microversion: 2.1 time: 0.227710 Oct 10 17:10:26.824820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 132/258] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:26 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:26.882526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:26.883390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:26.890634 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.893739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.894785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.911556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:26.912317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:26.913158 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:26.997134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-400166b6-e9e0-4c7b-ba22-6c64c2f97594 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Action: 'create', calling method: .version_select at 0x7f34ef577a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-764167818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyZH1YCAiU9s1WXjfRdwT0tdGFBMkmV+YQExEh2P0c4TH2mcYX78tC6cDKoGkrXopTfp4+Yy0fJva+DMerjNrFp9g+fM4ZvZYxU0HafyT9LWu5b5DScVBi76fWF/uA4kA=="}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:27.036163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-400166b6-e9e0-4c7b-ba22-6c64c2f97594 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for project c36e0d86e93942189945656ccb70c059. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:10:27.042318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-400166b6-e9e0-4c7b-ba22-6c64c2f97594 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for user d625c099d9134f78b3e8940879c19106 and project c36e0d86e93942189945656ccb70c059. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:10:27.100257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:27.109082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:27.110955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:27.112219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3a9bd75e-873e-41ae-a438-8018ad538467 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.233484 Oct 10 17:10:27.113157 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 133/259] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:26 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:27.144961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-400166b6-e9e0-4c7b-ba22-6c64c2f97594 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.468041 Oct 10 17:10:27.145902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 127/260] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:10:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:10:27.345299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:27.350001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:27.364614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:27.365120 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:27.365559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:27.366277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:27.366735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:27.367162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:27.568218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:27.580462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1647536d-bce3-4a18-b8b8-33867dbd11f1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.250896 Oct 10 17:10:27.581360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 134/261] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:27 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:27.856202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:27.864737 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:27.882631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:27.882631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:27.882631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:27.882631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:27.882933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:27.882933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.140513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:28.141590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:28.149995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.150762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.151797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.153014 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.154381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.155044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.157332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:28.167993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b58bd723-f8cc-403c-9695-b862427baead tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1701 microversion: 2.1 time: 0.317146 Oct 10 17:10:28.190176 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 128/262] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:27 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1701 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:28.202667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:28.219048 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.219661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.233410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.396306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Going to try to start instance {{(pid=119264) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 17:10:28.396859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:28.403334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:28.405776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:28.407338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6b6de29a-d211-45f4-a0d9-406a660313c2 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.272436 Oct 10 17:10:28.420632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 135/263] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:28 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:28.602758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:28.603399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:28.611571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.612126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.612569 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.613287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.613752 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.614182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.761344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:28.769978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c2b70103-d0c7-4710-a75f-bd38ab4c294b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.171069 Oct 10 17:10:28.770561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 136/264] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:28 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:28.956688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f4e035fc-f907-4aca-baa2-b64724e6288d tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action" status: 202 len: 0 microversion: 2.1 time: 0.756970 Oct 10 17:10:28.957365 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 129/265] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:10:28 2022] POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:10:28.965609 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:28.968234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:28.979773 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.980394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.980829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:28.981770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:28.982450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:28.983030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:29.195586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:29.234655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-feb2201d-e313-4896-bd87-0cfb6953a0c3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1710 microversion: 2.1 time: 0.273126 Oct 10 17:10:29.240959 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 137/266] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:28 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1710 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:29.435230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:29.436727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:29.449532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:29.452014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:29.452681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:29.453562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:29.457084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:29.457730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:29.798508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:29.799309 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:29.812220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:29.813061 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:29.813579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:29.815064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:29.816427 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:29.818386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:29.833887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:29.844484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:29.848578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:29.849899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f1b2a66e-3f85-44ff-bba2-bbc5d1e619cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.419347 Oct 10 17:10:29.850570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 130/267] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:29 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:30.152847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:30.176181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-53fb04b2-49ef-4310-bb45-cf66de29e030 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.375540 Oct 10 17:10:30.176181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 138/268] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:29 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:30.271445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:30.272221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:30.278748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:30.281071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:30.281071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:30.281071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:30.281071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:30.294997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:30.586691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:30.879143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:30.879851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:30.891797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:30.892334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:30.892771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:30.893548 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:30.896944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:30.897417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:31.099011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:31.115340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-74195069-8474-4c73-a402-b846e39105b6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1710 microversion: 2.1 time: 0.848259 Oct 10 17:10:31.129884 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 131/269] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:30 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1710 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:31.183657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:31.208923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:31.209953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:31.211186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:31.217805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:31.220605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-91220587-854d-4307-b8bf-5046bf78161c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.345783 Oct 10 17:10:31.223121 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:31.223619 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:31.224084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:31.224941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:31.225560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:31.226278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:31.231095 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 139/270] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:30 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:31.430096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:31.438445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e2598c1f-4db9-4f7c-8974-e6cbc6b2d40e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.243376 Oct 10 17:10:31.456539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:31 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:32.147914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:32.152638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:32.171130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.176683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.176683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.176683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.176683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.177053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.261543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:32.262283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:32.279788 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.281671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.284816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.286809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.288269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.289008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.389118 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:32.426886 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4cd0b1e3-82a9-4444-8094-563dcb2252ba tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1710 microversion: 2.1 time: 0.290132 Oct 10 17:10:32.427490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 140/272] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:32 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1710 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:32.467577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:32.469096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:32.490425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.491415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.492210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.493299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:32.493920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:32.496823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:32.844376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:32.856189 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:32.867803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:32.869340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:32.869718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7e294afa-2e3a-4fd3-9674-dae4c3722d97 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.612376 Oct 10 17:10:32.879890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 133/273] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:32 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:32.885839 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7813d843-fc6d-4484-bf5b-fa25ff7f3bd1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.426704 Oct 10 17:10:32.886953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 141/274] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:32 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:33.452831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:33.453591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:33.461402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.462081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.462859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:33.464340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.464340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.464540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:33.723150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:33.735513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-69553950-0ec3-4173-81f1-96555d648432 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1714 microversion: 2.1 time: 0.288393 Oct 10 17:10:33.736411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 134/275] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:33 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1714 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:33.904936 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:33.906232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:33.913381 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:33.913591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.913883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.914326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:33.914763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:33.915046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.915506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.915930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:33.921385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:33.924367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.924875 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.925342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:33.926229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:33.926854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:33.927293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:34.168666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:34.173640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:34.177939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:34.179422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:34.180803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0e5aed38-3005-4647-a72f-ff6eabf8312f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.284920 Oct 10 17:10:34.181535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 142/276] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:33 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:34.182467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5633c23f-4ee6-42be-a26f-d9018231563a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.275469 Oct 10 17:10:34.183331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 135/277] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:33 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:35.207549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:35.208172 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:35.208780 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:35.209388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:35.219619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:35.220639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:35.223434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:35.224905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:35.225504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:35.226525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:35.232633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:35.232633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:35.233076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:35.233076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:35.233268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:35.233268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:35.469086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:35.482101 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-34e72c9d-4f66-4b10-8e30-e9c7603ab72e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.278342 Oct 10 17:10:35.486216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 136/278] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:35 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:35.496340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:35.512655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:35.512655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:35.512655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ac87aa24-2c57-421c-a7e8-7e85446f7909 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.307764 Oct 10 17:10:35.513910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 143/279] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:35 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:36.520051 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:36.520051 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:36.526079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:36.526573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:36.527199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:36.527905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:36.529505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:36.529505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:36.537803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:36.539171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:36.546138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:36.546925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:36.547457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:36.548267 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:36.548790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:36.549400 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:36.795750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:36.806758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d59035c6-6aec-4b1e-a75c-69242696c8a2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.297130 Oct 10 17:10:36.809102 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 137/280] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:36 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:36.822833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:36.839001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:36.840625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:36.843044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-854f3201-db6e-4556-afeb-ecd01cc0a662 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.309597 Oct 10 17:10:36.843689 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 144/281] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:36 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:37.840433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:37.842197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:37.844322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=4 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:37.849812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:37.850324 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:37.850765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:37.851467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:37.851996 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:37.852448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:37.874676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:37.875933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:37.882794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:37.883876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:37.884348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:37.885214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:37.885699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:37.886131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:38.071091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:38.076672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:38.079375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4e286f30-8585-4bfa-8755-6d2c2e6045bf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.242786 Oct 10 17:10:38.079949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 138/282] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:37 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:38.085114 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:38.086939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:38.088312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8baa9b27-56f7-4b38-bc8a-e85de0fc5e4e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.217596 Oct 10 17:10:38.089152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 145/283] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:37 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:39.103171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:39.103717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:39.111062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:39.111551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:39.112036 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:39.116756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:39.116756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:39.116756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:39.119538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:39.120178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:39.127010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:39.127496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:39.127925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:39.128644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:39.129097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:39.129524 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:39.330197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:39.333494 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:39.338068 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2387e9b8-d9c7-4799-b354-44edd6a5ce34 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.238807 Oct 10 17:10:39.338974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 139/284] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:39 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:39.342190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:39.343684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:39.344903 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-37cd8fcd-bb40-4e90-aa9c-f016e85e90a7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1739 microversion: 2.20 time: 0.230053 Oct 10 17:10:39.345633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 146/285] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:39 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:40.362300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:40.362946 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:40.369808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:40.370407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:40.376772 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:40.377270 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:40.377703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:40.377821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:40.378270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:40.378421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:40.378699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:40.378835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:40.379254 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:40.379674 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:40.380146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:40.380733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:40.636552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:40.644292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-36071e6c-78f6-4be9-a5d7-b19ee44fdc83 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.286533 Oct 10 17:10:40.644865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 140/286] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:40 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:40.649033 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:40.657862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:40.659496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:40.663619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef9891a2-0e81-4259-ae8b-2c32c09d29df tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1721 microversion: 2.20 time: 0.294743 Oct 10 17:10:40.663619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 147/287] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:40 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:41.667271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:41.667940 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:41.674465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:41.674951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:41.675392 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:41.676103 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:41.676559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:41.676981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:41.688508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:41.689113 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:41.695814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:41.696344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:41.696774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:41.697457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:41.698185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:41.698637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:41.866232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:41.888409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:41.889367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b070a85e-0efe-48fc-ab8e-e45f422e400b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.225671 Oct 10 17:10:41.891454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 141/288] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:41 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:41.898690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:41.900636 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:41.902350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7efb223d-83e1-46a7-ab7d-f14570db5119 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1721 microversion: 2.20 time: 0.218365 Oct 10 17:10:41.903522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 148/289] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:41 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:42.914198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:42.914807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:42.922806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:42.922806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:42.922806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:42.923301 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:42.923754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:42.924208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:42.928789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:42.930281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:42.936919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:42.937479 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:42.938006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:42.938771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:42.939295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:42.939726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:43.121085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:43.128924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-372c83af-433c-44cb-bed1-6df5b4bd41b5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.218669 Oct 10 17:10:43.129493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:42 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:43.136936 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:43.145709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:43.147137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:43.148340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-20566c86-c918-4893-99c0-62d51dda37fd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1721 microversion: 2.20 time: 0.223953 Oct 10 17:10:43.148879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 149/291] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:42 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:44.151869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:44.152444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:44.158828 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:44.159308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:44.159746 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:44.160470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:44.160926 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:44.161350 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:44.174488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:44.175095 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:44.181511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:44.182020 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:44.182451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:44.183133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:44.183579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:44.183996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:44.357929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:44.361888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:44.366514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bf4704cd-263a-4994-b3f7-53f6eb101658 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.218563 Oct 10 17:10:44.369139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 143/292] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:44 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:44.370228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:44.371762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:44.373603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e91ab106-0dfe-4e54-87f5-52a883a776e5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1721 microversion: 2.20 time: 0.202907 Oct 10 17:10:44.374189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 150/293] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:44 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:45.390672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:45.391306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:45.397613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:45.398097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:45.398510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:45.398908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:45.399126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:45.399249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:45.399652 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:45.400159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:45.406544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:45.407148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:45.407583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:45.408301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:45.408754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:45.409174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:45.596973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:45.603840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:45.609064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a7a830d0-17fc-4cd1-9197-cc2b6a74be49 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.222825 Oct 10 17:10:45.610699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 144/294] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:45 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:45.612863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:45.615108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:45.616751 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-efa8b540-d9f0-41cd-a890-132becd5af8d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1721 microversion: 2.20 time: 0.221945 Oct 10 17:10:45.628775 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 151/295] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:45 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:45.659226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "name": "network-vif-unplugged", "status": "completed", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:45.670154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:45.670640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:45.671070 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:45.682597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] Creating event network-vif-unplugged:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:10:45.688233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-ae68f727-82b4-43b2-81d0-2b9fec0e0586 req-9a373de8-995a-4a24-9169-c3ae563cdb99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032709 Oct 10 17:10:45.689280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 145/296] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:10:46.637289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:46.638295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:46.647043 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:46.647778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:46.650521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.651031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.651462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:46.652210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.652653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.658450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:46.658595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.658595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.658595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:46.658595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.658896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.658896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:46.866123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:46.870487 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:46.885354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:46.885667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-60ff6332-6d42-4f27-a93d-eec78c82800e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.253451 Oct 10 17:10:46.886253 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 152/297] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:46 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:46.893416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:46.894621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-91cad557-6e30-4f16-838b-f3722266c3c1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1724 microversion: 2.20 time: 0.253480 Oct 10 17:10:46.895368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 146/298] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:46 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:46.920415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5f17ff5-e617-476a-8700-ba174375f441"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:46.923000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:46.929210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.929688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.930460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:46.931174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:46.931788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:46.932235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:47.909180 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:47.910636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:47.914355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:47.920144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:47.920668 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:47.921688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:47.922475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:47.923087 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:47.923508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:47.950184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8ed2969a-c77b-4233-9651-877abdf6e741 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.034020 Oct 10 17:10:47.956734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 153/299] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Oct 10 17:10:46 2022] POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments => generated 188 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:10:48.101036 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:48.111850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6e428736-8e64-420a-9c8a-b6cfc734ffb4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.206766 Oct 10 17:10:48.123233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 147/300] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:47 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:10:48.157874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:48.158552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:48.165152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:48.165668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:48.166120 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:48.166794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:48.167383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:48.167801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:48.216703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119263) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 17:10:48.476607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cbc56111-2cf7-4951-9074-e2cf3300f71b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/action" status: 202 len: 0 microversion: 2.20 time: 0.323346 Oct 10 17:10:48.480237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 154/301] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 10 17:10:48 2022] POST /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:10:48.486180 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:48.486785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:48.495331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:48.495879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:48.496397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:48.497473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:48.497704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:48.498116 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:48.645469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:48.651352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:48.658556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:48.662241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:48.663566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-469c2b45-1ecf-4d72-97b4-78a05c64e11d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1750 microversion: 2.20 time: 0.182121 Oct 10 17:10:48.664459 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 148/302] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:48 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:49.141204 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:49.141813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:49.143662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:49.148343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:49.148824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:49.149404 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:49.150083 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:49.150532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:49.150955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:49.156137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:10:49.293850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:49.301694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2c07282f-dd4d-4294-adf3-f776c9ce2440 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.164913 Oct 10 17:10:49.302255 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 155/303] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:49 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:49.691540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:49.692296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:49.698752 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:49.699228 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:49.699658 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:49.700361 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:49.700813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:49.701233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:49.834853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:49.843482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:49.844960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:49.846133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a20749f5-7cdc-4f5f-a9d6-364897cbfcff tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1750 microversion: 2.20 time: 0.159779 Oct 10 17:10:49.846653 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 149/304] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:49 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:50.326410 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:50.327014 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:50.334390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:50.334868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:50.335306 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:50.335984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:50.336466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:50.336884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:50.466451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:50.474163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6b566873-08cc-430a-ab9d-eadd21db6f74 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.152205 Oct 10 17:10:50.474719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 156/305] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:50 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:50.871166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:50.871776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:50.878941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:50.879429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:50.879869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:50.880604 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:50.881060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:50.881486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:51.009649 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:51.018200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:51.019627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:51.020880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-751447a6-238e-4bc5-8623-e3ed1e80b2b7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1750 microversion: 2.20 time: 0.153677 Oct 10 17:10:51.021373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 150/306] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:50 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:51.502506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:51.502506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:51.504130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:51.504622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:51.505060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:51.505759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:51.506219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:51.506640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:51.646669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:51.654249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c448d646-eef3-4353-8134-46588bf4261b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.161085 Oct 10 17:10:51.654797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 157/307] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:51 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:52.046039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:52.046633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:52.053425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:52.053915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:52.054351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:52.055053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:52.055501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:52.055924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:52.186690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:52.195638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:52.197099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:52.198242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1e423e08-2bcc-49f7-8559-024b8b35d8d7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1752 microversion: 2.20 time: 0.156245 Oct 10 17:10:52.198791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 151/308] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:52 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:52.679705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:52.680362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:52.688372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:52.688854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:52.689663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:52.690365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:52.691505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:52.691937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:52.865743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:52.874973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-eece6558-8f05-4a0e-887c-41eb1d24b4f3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.200726 Oct 10 17:10:52.875638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 158/309] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:52 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:53.224561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:53.225197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:53.231451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:53.231935 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:53.232400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:53.233086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:53.233532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:53.233950 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:53.371178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:53.380999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:53.382437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:53.383591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5b1c22a7-3b62-4d65-b7f8-0bbbffb37529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1752 microversion: 2.20 time: 0.162942 Oct 10 17:10:53.384164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 152/310] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:53 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:53.899734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:53.900409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:53.907926 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:53.908442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:53.908869 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:53.909562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:53.910006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:53.910446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:54.041064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:54.050336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-78b825fd-27cd-4c47-ad62-6de7761e15e1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1521 microversion: 2.1 time: 0.154485 Oct 10 17:10:54.050916 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 159/311] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:53 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:54.410241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:54.410874 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:54.417153 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:54.417632 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:54.418067 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:54.418747 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:54.419201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:54.419623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:54.553243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:54.562417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:54.563859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:54.565268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0436640c-8be4-4d44-8e93-3e3aaf411847 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1752 microversion: 2.20 time: 0.159022 Oct 10 17:10:54.566085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 153/312] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:54 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:55.073769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:55.074399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:55.081398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.081885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.082372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.083051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.083501 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.083910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.275378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:55.275378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-69be7aef-5044-414f-8073-7076be64a646 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1501 microversion: 2.1 time: 0.180975 Oct 10 17:10:55.275378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 160/313] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:55 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:55.288846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:55.289456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:55.297570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.297570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.297570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.297570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.297951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.298114 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.440358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:55.449173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-efd78456-aad2-4991-8454-0051d6722858 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1516 microversion: 2.1 time: 0.164245 Oct 10 17:10:55.449783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 154/314] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:55 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:55.592402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:55.593856 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:55.600923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.601415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.601856 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.602671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:55.603122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:55.603541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:55.747469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:55.757463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:55.758899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:55.760154 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1f492f58-b283-4c8b-b349-f8639a6c88f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1752 microversion: 2.20 time: 0.172869 Oct 10 17:10:55.760827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 161/315] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:55 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:10:56.789355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:56.789966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:56.797709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:56.798203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:56.798639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:56.799343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:56.799791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:56.800257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:57.089596 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:57.094515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:57.096375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:57.097554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e3e8a10b-db82-44a4-9fcb-27a2d9fe6876 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.312513 Oct 10 17:10:57.098131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 155/316] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:56 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:57.366660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:10:57.368991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:57.376383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:57.376876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:57.377309 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:57.378008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:57.378538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:57.378964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:57.403228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'flavor' on Instance uuid e69da494-0060-4875-9dc0-625701fa03b5 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:10:57.718750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-25ea9f94-89d7-4f58-bf3e-8087fd40863e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/action" status: 200 len: 32 microversion: 2.1 time: 0.355433 Oct 10 17:10:57.719451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 162/317] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:10:57 2022] POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:10:57.729204 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:57.729816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:57.735936 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:57.736457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:57.736889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:57.737585 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:57.738030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:57.738451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:57.896136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:57.900069 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-096e99d1-07e6-406d-a483-340e4aac23a6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.174878 Oct 10 17:10:57.900641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 156/318] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:57 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:58.125999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:58.129086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:58.137871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:58.138999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:58.140879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:58.141875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:58.143283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:58.144389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:58.343419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:58.350011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:58.351690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:58.352935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ec03c0c8-de37-4dec-a389-d8eabe0c1082 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.232910 Oct 10 17:10:58.355008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 163/319] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:58 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:10:58.928273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:58.929049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:58.940540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:58.949478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:58.950245 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:58.952189 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:58.952673 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:58.958000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:59.174494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:59.199422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-57f23f07-6812-4913-8248-fb444d3965be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.279056 Oct 10 17:10:59.199997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 157/320] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:10:58 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:10:59.383767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:10:59.385870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:10:59.401954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:59.401954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:59.401954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:59.401954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:10:59.402846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:10:59.402846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:10:59.559195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:59.569214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:59.570666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:10:59.571841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2fcd9198-0f18-468a-be6e-99cd28654702 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.192231 Oct 10 17:10:59.572580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 164/321] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:10:59 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:00.223546 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:00.224228 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:00.243531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:00.244017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:00.244484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:00.245186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:00.245700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:00.246381 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:00.455797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:00.466761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-676e70bf-445d-4413-98b4-a4c0607669d0 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.247519 Oct 10 17:11:00.468582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:00 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:00.598515 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:00.599263 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:00.611847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:00.612451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:00.614185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:00.615432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:00.616453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:00.617960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:00.808722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:00.845085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:00.846515 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:00.847691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-32d526c3-7adc-490f-946b-25315212c8b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.253292 Oct 10 17:11:00.848276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 165/323] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:00 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:01.494962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:01.495518 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:01.511738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:01.512268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:01.512705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:01.513411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:01.513859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:01.514282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:01.687574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:01.696040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0a134c6d-686d-4a59-880c-ed31989994a5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.204951 Oct 10 17:11:01.704068 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 159/324] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:01 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:01.875105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:01.875702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:01.882163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:01.882964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:01.883694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:01.884427 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:01.884946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:01.885674 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:02.045472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:02.054990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:02.056906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:02.058357 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-595fef7f-a11f-416d-8a81-efaea2c11529 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.187707 Oct 10 17:11:02.059103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 166/325] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:01 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:02.722029 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:02.723261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:02.730399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:02.731290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:02.732007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:02.732889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:02.734117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:02.734702 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:02.878853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:02.887889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a19814c5-7ad9-45d5-bbfe-39cc68761060 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.170807 Oct 10 17:11:02.906537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 160/326] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:02 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:03.088099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:03.088099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:03.093997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:03.094486 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:03.095126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:03.095833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:03.096390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:03.096815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:03.247688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:03.263201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:03.269566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:03.270777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fbd5502b-c972-46dc-9f8a-ec94ca1fee33 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.190618 Oct 10 17:11:03.272374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 167/327] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:03 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:03.849216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1869819770", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764167818", "security_groups": [{"name": "tempest-secgroup-smoke-1574135174"}], "block_device_mapping_v2": [{"uuid": "93e60741-653d-4adf-8565-66333d9b7e01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d40eb576-47ec-4491-b3a9-6394e24cb47e"}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:03.915847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:03.916890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:03.924393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:03.925249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:03.925750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:03.932492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:03.934228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:03.934746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:04.001390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] validate_networks() for [('d40eb576-47ec-4491-b3a9-6394e24cb47e', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:11:04.181377 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:04.190245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-aba5982b-370c-4e09-bbc2-c206b5814067 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.278535 Oct 10 17:11:04.190491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 168/328] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:03 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:04.299841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:04.301471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:04.313278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:04.313857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:04.314365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:04.315138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:04.315655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:04.316418 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:04.597641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:04.633929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:04.633929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:04.633929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:04.634474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:11:04.634474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:11:04.634474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:11:04.634724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5f919dec-7c0e-490f-9be9-40f0a0c76a01 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.319336 Oct 10 17:11:04.634811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:11:04.634811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:11:04.634990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 169/329] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:04 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:04.635088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:04.635088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:04.635088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:04.635088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:04.635451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:04.635451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:04.659010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:11:04.664727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for user d625c099d9134f78b3e8940879c19106 and project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:11:04.748042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:11:04.750811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93e60741-653d-4adf-8565-66333d9b7e01',volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:11:05.214731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:05.216013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:05.223931 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:05.224709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:05.225344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:05.226220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:05.226833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:05.227415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:05.387389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:05.407285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d4321ed3-0990-40fe-a6be-58041d4eed5e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.196318 Oct 10 17:11:05.414999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 170/330] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:05 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:05.663796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:05.664955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:05.671313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:05.671972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:05.672628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:05.673412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:05.674073 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:05.675068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:05.829489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:05.838715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:05.840302 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:05.841567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f9ba6b8a-8cb7-46e4-b6da-d52cb4dcd7da tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.182110 Oct 10 17:11:05.842231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 171/331] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:05 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:06.020289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fb71d851-b0aa-4123-8b8e-63db4ac1a450 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.175248 Oct 10 17:11:06.021535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 161/332] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:11:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:11:06.033939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-08b2ab79-38be-406a-b76b-09f9a0551102 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:06.034923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-08b2ab79-38be-406a-b76b-09f9a0551102 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:06.124563 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-08b2ab79-38be-406a-b76b-09f9a0551102 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:06.128428 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-08b2ab79-38be-406a-b76b-09f9a0551102 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1094 microversion: 2.1 time: 0.099589 Oct 10 17:11:06.129639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 172/333] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:06 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:06.441253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:06.442094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:06.448460 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:06.448944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:06.449376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:06.450072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:06.450517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:06.450938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:06.588152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:06.596794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0c63d7fe-816c-4738-951d-74066c45e00a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.159756 Oct 10 17:11:06.597716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 162/334] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:06 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:06.867530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:06.868186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:06.875141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:06.875622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:06.876083 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:06.876783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:06.877236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:06.877666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:07.010776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:07.020100 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:07.021577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:07.022719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d0196e42-4a1b-4d73-a2ff-d2916c4f03ea tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.159132 Oct 10 17:11:07.023270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 173/335] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:06 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:07.154760 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:07.155288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:07.161654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:07.162144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:07.162581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:07.163276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:07.163728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:07.164183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:07.237039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:07.245042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0f84ccd0-0f3a-4f37-896c-53f5e384debe tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1144 microversion: 2.1 time: 0.094229 Oct 10 17:11:07.245688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 163/336] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:07 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:07.619888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:07.620599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:07.627138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:07.627614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:07.628074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:07.628762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:07.629210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:07.629628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:07.756121 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:07.763632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cb5290cd-e312-4678-bf39-8205891fb769 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.147563 Oct 10 17:11:07.764214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 174/337] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:07 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:08.048200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:08.048902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:08.055152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.056570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.056570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.056801 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.057171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.057639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.209649 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:08.219401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:08.220880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:08.222071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4d6b7106-0025-4d04-a6c9-6d42fad73c32 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.178433 Oct 10 17:11:08.222625 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 164/338] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:08 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:08.271693 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:08.272430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:08.278951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.280631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.280631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.281272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.281712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.282135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.344122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:08.351885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c0bdafa9-246e-42f4-9b1e-b760a376c40b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1192 microversion: 2.1 time: 0.084140 Oct 10 17:11:08.352470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 175/339] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:08 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:08.787150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:08.787668 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:08.793733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.794221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.801139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.801139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:08.801139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:08.801139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:08.930251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:08.938765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0d9cd95b-9d6c-4764-9503-d504e812b8db tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.155570 Oct 10 17:11:08.940289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 165/340] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:08 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:09.248246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:09.249406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:09.255259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.255760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.256226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:09.257180 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.257771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.258277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:09.378388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:09.379002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:09.385916 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.391472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.391472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:09.391472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.391472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.391851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:09.392623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:09.456063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:09.465005 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:09.466628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:09.468419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-271bb547-85eb-4da9-9353-17f21c1c1144 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.224075 Oct 10 17:11:09.471877 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 176/341] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:09 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:09.502591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:09.522709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-064d5a4e-bba6-46e9-81b9-77e1e1134aaf tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1210 microversion: 2.1 time: 0.136334 Oct 10 17:11:09.528322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 166/342] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:09 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:09.962912 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:09.963523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:09.972964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.973446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.974115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:09.975032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:09.975819 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:09.980064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:10.192205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:10.202467 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-095b332f-1a1c-4c08-8e51-4899e2f2eaf8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.242738 Oct 10 17:11:10.205949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:09 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:10.499734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:10.500613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:10.516327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:10.517224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:10.517890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:10.519128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:10.522481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:10.525972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:10.546815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:10.547416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:10.566836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:10.567585 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:10.568392 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:10.569399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:10.569966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:10.570596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:10.997660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:11.006845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:11.007014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:11.008463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:11.009629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4ede253c-b3c5-4689-92a5-3823eccade0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.519198 Oct 10 17:11:11.010209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 167/344] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:10 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:11.016254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9505b289-0aab-4321-85a0-8d2ab2cf0107 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1278 microversion: 2.1 time: 0.473451 Oct 10 17:11:11.016889 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 178/345] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:10 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1278 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:11.226182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:11.226798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:11.233047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:11.233528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:11.233967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:11.234654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:11.235106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:11.235528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:11.422533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:11.430386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d41550a2-f724-47c3-8c2a-024f33818cce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.208100 Oct 10 17:11:11.430943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 168/346] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:11 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:11.518847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cead3c66-8618-4516-acda-9378f83705ce", "tag": "7a29d464-4f74-45c8-b0f8-366ab7fa8148"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:11.528973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:11.529446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:11.529948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:11.540900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] Creating event network-changed:7a29d464-4f74-45c8-b0f8-366ab7fa8148 for instance cead3c66-8618-4516-acda-9378f83705ce on hv-cinder-83454 Oct 10 17:11:11.546396 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-25a87194-3773-405b-8462-c8134a8add27 req-d765ad9a-8e86-4ec8-b689-b3642058b3d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031932 Oct 10 17:11:11.547209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 179/347] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:12.034871 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:12.036082 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:12.042387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.042936 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.043055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:12.043303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.043707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:12.043994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.044471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.044892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.051127 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.051613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.052068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.052768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.053216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.053633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.339504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:12.348215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:12.349744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:12.350977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f3d44956-d76a-4496-8785-4894cd4d3b80 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.320105 Oct 10 17:11:12.351739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 169/348] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:12 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:12.367148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:12.380332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-dde71837-fccb-4606-a13f-2a9270cb0a93 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.341304 Oct 10 17:11:12.385278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 180/349] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:12 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:12.454579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:12.455237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:12.461123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.461604 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.462034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.462718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:12.463166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:12.463586 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:12.591840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:12.600085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-14d634ef-820c-422e-a97b-cbf000b911c6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.149538 Oct 10 17:11:12.600646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 170/350] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:12 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:13.381764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:13.382368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:13.389595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.390079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.390505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.391192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.391633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.392074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.403006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:13.403723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:13.410996 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.411622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.412341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.413295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.413923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.414448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.590383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:13.594712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:13.599616 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:13.601148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:13.602300 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b180bb02-740e-4a68-ba0c-a5029bfba15d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.224436 Oct 10 17:11:13.602646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-10ecbea0-8ad2-45b7-a992-0f5a74015a08 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.203493 Oct 10 17:11:13.602850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 181/351] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:13 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:13.603216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 171/352] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:13 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:13.622195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:13.622787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:13.629042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.629524 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.629954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.630624 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:13.631067 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:13.631479 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:13.756597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:13.764867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c239973b-4fbb-4d0a-82c2-2488af110d96 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.145562 Oct 10 17:11:13.765425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 182/353] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:13 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:14.625471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:14.626079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:14.628153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:14.628701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:14.632650 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.633134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.633571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.634319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.634777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.635185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.635308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.635615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:14.635731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.636194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.636887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.637336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.637757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.675098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:14.831872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:14.838784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:14.839686 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ecb5acc2-a583-4507-ba62-04ae51bb2626 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.218629 Oct 10 17:11:14.840276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 172/354] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:14 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:14.846041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:14.846724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:14.849831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:14.849831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:14.850098 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ec6e480f-efc4-4560-921d-55cf3c9f1406 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.226456 Oct 10 17:11:14.860138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 183/355] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:14 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:14.860332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.860332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.860332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.860332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:14.860721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:14.860721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:14.989153 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:14.996886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c935fda7-b82e-41ad-90c1-b991b3df27b2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.154838 Oct 10 17:11:14.997449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 173/356] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:14 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:15.862733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:15.863258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:15.869663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:15.870149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:15.871851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:15.871851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:15.871851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:15.872151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:15.878784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:15.879392 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:15.885844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:15.886326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:15.886762 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:15.887486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:15.887935 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:15.888382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:16.068592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:16.072395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:16.076927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c789d3ae-cbca-43f3-8c87-bac65022db58 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.218129 Oct 10 17:11:16.077502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 184/357] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:15 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:16.080968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:16.082152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:16.082402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:16.082651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:16.083561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-69d4fe63-0c13-4e6c-ac5e-4bf00ed3602c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.210142 Oct 10 17:11:16.096185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 174/358] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:15 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:16.096391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:16.096482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:16.096570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:16.096647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:16.096721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:16.096721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:16.096721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:16.096721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:16.096989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:16.096989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:16.096989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:16.097222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:16.098325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:16.098762 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:16.147503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:16.219832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lazy-loading 'services' on Instance uuid 83890954-0bab-4582-a1a0-46ba1a3d846e {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:11:16.232382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:16.241023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c8bd080f-982c-4491-892d-c943705c6759 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.155653 Oct 10 17:11:16.241643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 175/359] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:16 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:16.473394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b72524ea-a9d7-4da9-804c-b6e034ab3481 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments/f811965d-74fc-4f77-809a-ac0f58c0681f" status: 202 len: 0 microversion: 2.1 time: 0.394705 Oct 10 17:11:16.473975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 185/360] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:11:16 2022] DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments/f811965d-74fc-4f77-809a-ac0f58c0681f => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:11:17.102674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:17.103320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:17.110388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.110869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.111298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.111605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:17.112045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.112345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:17.112461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.112846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.119229 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.119719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.120284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.120933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.121388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.121842 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.341978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:17.347009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:17.365286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-85fa8849-6fba-4b82-ba1f-6bb236bcc9ca tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.266356 Oct 10 17:11:17.368214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:17 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:17.370975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:17.372514 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:17.372850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:17.374019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:17.375025 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-50fa5348-14e1-4b7f-a97d-ae238936cb47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.268066 Oct 10 17:11:17.376824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 186/362] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:17 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:17.380131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.380622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.381059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.381779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:17.382395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:17.382989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:17.516994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:17.524888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c213be13-7474-4371-869e-c37cfaa80183 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.155589 Oct 10 17:11:17.525473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 177/363] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:17 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:18.392641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:18.393249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:18.400674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:18.401420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:18.403362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.403860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.404336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.405045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.405504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.405973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.408857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.409413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.409914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.410690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.411202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.411696 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.425131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:18.610761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:18.615430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:18.627252 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-31049341-6545-435d-a7bb-0843a385f55a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.239341 Oct 10 17:11:18.628464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 187/364] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:18 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:18.631711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:18.634197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:18.637568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bae3d98d-8fe2-4219-a033-aee61270f22d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.240307 Oct 10 17:11:18.637912 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:18.639155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:18.650274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 178/365] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:18 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:18.650416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.651330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.652169 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.653470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.655733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.655733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.675569 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:18.680697 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:18.688709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.689662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.690371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.717037 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Going to try to stop instance {{(pid=119264) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 17:11:18.800840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:18.808358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9c191207-4eaf-4a3c-a696-76802aef4cea tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.178388 Oct 10 17:11:18.808918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 188/366] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:18 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:18.905857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8108c08e-d074-429d-b660-3d8567b6b7e0 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action" status: 202 len: 0 microversion: 2.1 time: 0.243748 Oct 10 17:11:18.907084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 179/367] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:11:18 2022] POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:11:18.915006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:18.920922 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:18.923301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.924198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.924822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:18.925726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:18.926362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:18.926969 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.083342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:19.090989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8b723161-1f22-4b70-adbd-769d51c2a914 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.179886 Oct 10 17:11:19.091553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 189/368] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:18 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:19.651136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:19.651853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:19.658582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.661555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.661555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.661555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.661555 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.661964 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.682567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:19.683167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:19.690194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.690612 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.691293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.691971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.692442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.692861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.864134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:19.868607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:19.872375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-200dcfad-64d5-4f85-9969-ba9762505c29 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.225862 Oct 10 17:11:19.872944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 180/369] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:19 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:19.877813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:19.878431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:19.879657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:19.881136 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:19.882337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8411ed41-b45d-4afe-90cd-6c0da65435b6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.203561 Oct 10 17:11:19.883211 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 190/370] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:19 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:19.884323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.884807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.885239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:19.885939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:19.886437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:19.886815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.018249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:20.021928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:20.026274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d10d8168-8c10-4961-8888-42c8fd686ecf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.152087 Oct 10 17:11:20.027006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 181/371] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:19 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:20.114223 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:20.114861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:20.120934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.121581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.122112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.122797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.123289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.123651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.253594 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:20.261348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-24ca55e1-fee6-448d-a956-d6d0ba290e2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.151045 Oct 10 17:11:20.261897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 191/372] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:20 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:20.894856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:20.895462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:20.902570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.903200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.903547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.904262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.904859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.905281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.908429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:20.909063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:20.915137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=76 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:20.916525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.917210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.917649 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:20.921672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:20.921672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:20.921672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.107359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.111852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.116425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3ae35701-044d-4989-93ce-eef27e50ae80 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.225462 Oct 10 17:11:21.121032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.122511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.124329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c25dbc44-0de3-4f80-a70f-544ad6ce035e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.219624 Oct 10 17:11:21.125092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 192/373] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:20 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:21.129335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cead3c66-8618-4516-acda-9378f83705ce", "name": "network-vif-plugged", "status": "completed", "tag": "7a29d464-4f74-45c8-b0f8-366ab7fa8148"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:21.132901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 182/374] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:20 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:21.137842 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:21.138836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:21.139380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:21.139746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.155122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:21.158131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] Creating event network-vif-plugged:7a29d464-4f74-45c8-b0f8-366ab7fa8148 for instance cead3c66-8618-4516-acda-9378f83705ce on hv-cinder-83454 Oct 10 17:11:21.163113 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-763b9492-90fe-419d-a1e6-e77a9052c284 req-ecbdcaa8-a753-42ac-a216-e5ddbe53f59d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 Oct 10 17:11:21.163624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:21.163744 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 193/375] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:21.164463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:21.164906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.165680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:21.166138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:21.166563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.286923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:21.287984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:21.294457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:21.296116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:21.296116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.296807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:21.297323 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:21.297748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:21.313241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.322388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-db08d899-c1a9-4867-ab24-0acd65cbf7e8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.188288 Oct 10 17:11:21.322960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 183/376] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:21 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:21.463234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:21.473371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5ee01123-dc2c-4b2c-9a44-a5ce67c16025 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.190816 Oct 10 17:11:21.474295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 194/377] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:21 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:22.159805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:22.160450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:22.161734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:22.162415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:22.166624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.167108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.167545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.168453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.168908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.171151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.171266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.171356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.171356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.171356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.171780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.172225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.363616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.368347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.371647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e1a45c7b-283a-4ab1-a93e-55be81733810 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.215669 Oct 10 17:11:22.372284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 184/378] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:22 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:22.376712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:22.377324 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:22.380263 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.383123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.384388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-16c06549-19c3-4544-abe7-a1f63ae55e0e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.226907 Oct 10 17:11:22.392317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 195/379] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:22 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:11:22.395462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.395957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.396425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.397128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.397575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.397993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.497282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:22.497887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:22.504292 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.504788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.505219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.505958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:22.506352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:22.506772 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:22.528631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.536369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-95d5f196-2bf6-4588-b470-bce8ef696c01 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.163093 Oct 10 17:11:22.537009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 185/380] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:22 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:22.638646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:22.647065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d6166de0-e542-4515-b9d0-187381891e02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.153590 Oct 10 17:11:22.647629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 196/381] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:22 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:23.187378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "name": "network-vif-plugged", "status": "completed", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:23.197567 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.198044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.198475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.209746 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] Creating event network-vif-plugged:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:11:23.214509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-64b68729-9b31-41d3-a752-aa9957087067 req-886ed8c6-5d26-4703-96e0-4f64c5426859 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030762 Oct 10 17:11:23.215064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 186/382] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:23.393540 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:23.394224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:23.400528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.401049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.401485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.402270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.402625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.403048 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.411981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:23.412976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:23.419073 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.419707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.421223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.422874 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.423537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.423968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.619576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.622953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.634587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.635390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-44ced800-f19a-4070-91de-8b4564f4fa35 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1266 microversion: 2.1 time: 0.245588 Oct 10 17:11:23.635961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 197/383] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:23 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:23.636117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.637284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4cd5b80e-a42c-4f7f-83a5-d9c7cd35c7f6 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.229501 Oct 10 17:11:23.638105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 187/384] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:23 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:23.645525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:23.646178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:23.652244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.652731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.653166 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.653851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.654316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.654748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.669620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:23.670232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:23.676133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.676623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.677064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.677761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:23.678216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:23.678647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:23.859210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.867211 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-98b11f5d-4fad-4090-af19-56f11b50a280 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.229858 Oct 10 17:11:23.867983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 198/385] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:23 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:23.871419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:23.881876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d397e5ec-af0b-41be-bde5-bba5378c67d6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.215027 Oct 10 17:11:23.884376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 188/386] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:23 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:24.659282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:24.659797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:24.663163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:24.663772 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:24.665769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.666250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.666700 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.667364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.667807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.668253 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.670674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.671153 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.671588 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.672300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.672750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.673168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.867846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:24.875072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:24.878125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-afb296c6-825c-4548-a156-fcac4af2c4e2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1454 microversion: 2.1 time: 0.222975 Oct 10 17:11:24.883127 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 199/387] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:24 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:24.884786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:24.886282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:24.887709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-18ffbefb-6ff0-4410-be00-93f75c689e34 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.228220 Oct 10 17:11:24.888685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 189/388] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:24 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:24.892647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:24.893618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:24.900765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.901275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.906058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.906058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.906058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.906058 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.912339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:24.912870 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:24.919115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.919642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.920725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:24.921426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:24.921877 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:24.922299 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:25.309547 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:25.321652 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8feb49ea-985c-4261-a955-71303095b993 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.432890 Oct 10 17:11:25.322267 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 200/389] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:24 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:25.324434 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:25.327323 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:25.327930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:25.332977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bdeb2834-2abf-48c5-990c-040d19c7f06c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1454 microversion: 2.1 time: 0.431878 Oct 10 17:11:25.333707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 190/390] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:24 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1454 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:25.333915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:25.334409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:25.334851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:25.335543 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:25.336002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:25.336450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:25.473729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:25.481592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-96b1140d-3a42-4689-815f-52c81a6ded4f tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.158425 Oct 10 17:11:25.482149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 201/391] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:25 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:25.918764 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:25.919365 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:25.925872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:25.926444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:25.927023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:25.927577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:25.928058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:25.928479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:26.140342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:26.156382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:26.158019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:26.159235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b690375e-1a96-44f3-9bfb-5c7d49aa0c76 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.244488 Oct 10 17:11:26.159791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 191/392] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:25 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:26.347620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:26.348251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:26.355155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:26.355637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:26.356485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:26.358090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:26.358928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:26.359410 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:26.506474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:26.507107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:26.514064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:26.514761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:26.515193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:26.515893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:26.516402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:26.516818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:26.609158 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:26.617246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-feb18080-2747-4024-ab9f-c9c59af7da63 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.273954 Oct 10 17:11:26.617814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 202/393] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:26 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:26.701130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:26.710435 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b58a91f7-5fdf-4e64-b2bf-1fece42d7561 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.209279 Oct 10 17:11:26.711185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 192/394] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:26 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:27.187305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:27.187992 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:27.194188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.194667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.195163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.195867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.196347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.196766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.443149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:27.453073 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:27.454737 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:27.456293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-01f96147-5667-4b87-9dc3-fbe877bed20b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1808 microversion: 2.20 time: 0.273190 Oct 10 17:11:27.457313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 203/395] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:27 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:27.641091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:27.641703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:27.648429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.649145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.649581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.650286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.650740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.651279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.703603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cead3c66-8618-4516-acda-9378f83705ce", "tag": "7a29d464-4f74-45c8-b0f8-366ab7fa8148"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:27.718315 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.722356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.723564 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.744969 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] Creating event network-changed:7a29d464-4f74-45c8-b0f8-366ab7fa8148 for instance cead3c66-8618-4516-acda-9378f83705ce on hv-cinder-83454 Oct 10 17:11:27.756183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-04c093fb-46e5-48df-b707-1c3d2898c457 req-c6eaea67-942e-4ab1-9b18-808d24e42d87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053518 Oct 10 17:11:27.764256 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 204/396] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:27.778800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:27.779852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:27.787884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.790657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.790657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.790657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:27.790657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:27.791116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:27.813649 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:27.831637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:27.848449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2bdf8fe9-6ce3-4e53-8dfc-0f5f61d9df73 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.210963 Oct 10 17:11:27.849717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 193/397] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:27 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:27.966919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:27.975214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c7066660-08e0-4bb1-af8e-a78dd3ccd506 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.209413 Oct 10 17:11:27.976008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 205/398] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:27 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:28.482973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:28.485084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:28.492165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:28.494459 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:28.499088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:28.499950 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:28.500570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:28.501089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:28.651867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:28.662028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:28.663462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:28.664862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e7cbcfc6-30b0-489e-98af-d4bf18256609 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1795 microversion: 2.20 time: 0.186525 Oct 10 17:11:28.665578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 194/399] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:11:28 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1795 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:11:28.873494 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:28.874294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:28.881342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:28.881912 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:28.882425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:28.883195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:28.883720 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:28.884294 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:28.999345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:28.999953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:29.010013 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:29.010712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:29.011299 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:29.012208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:29.012807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:29.013480 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:29.033208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:29.042685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a104520a-f37a-454f-bf40-55e9222a7a6b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.173610 Oct 10 17:11:29.043582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 206/400] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:28 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:29.149245 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:29.156928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4fec3afe-564f-4e56-a6a1-32e94ee6a5d9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1678 microversion: 2.1 time: 0.162116 Oct 10 17:11:29.157491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 195/401] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:28 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:30.068223 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:30.068794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:30.075463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.075990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.078603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.078603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.078603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.078603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.182055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:30.183322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:30.198620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.199128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.199576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.200474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.200935 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.201366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.215339 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:30.224517 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6b3b9ebb-9d47-42ae-b309-217ba8085d7f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.160811 Oct 10 17:11:30.237300 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 207/402] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:30 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:30.387438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:30.395974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1bcdd522-45f5-465d-ae1f-3f30c653811b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1655 microversion: 2.1 time: 0.219109 Oct 10 17:11:30.396855 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 196/403] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:30 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1655 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:30.418430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:30.424539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.425017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.425447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.447337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Going to try to start instance {{(pid=119263) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 17:11:30.607654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d3b484bb-61b1-4285-ae88-8f15a1db4f8c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action" status: 202 len: 0 microversion: 2.1 time: 0.192905 Oct 10 17:11:30.608291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 208/404] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:11:30 2022] POST /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:11:30.618209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:30.618823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:30.629797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.629797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.629797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.629797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:30.630243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:30.630243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:30.758234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:30.766794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9d9c5f82-6276-4219-a702-f4655e350c02 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1664 microversion: 2.1 time: 0.152909 Oct 10 17:11:30.767454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 197/405] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:30 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:31.248951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:31.249683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:31.255650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:31.256165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:31.256595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:31.257273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:31.257719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:31.258130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:31.410582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:31.418509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5fae89f5-a116-454a-be99-964d0a6ed73c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.174257 Oct 10 17:11:31.419076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 209/406] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:31 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:31.790051 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:31.790669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:31.797094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:31.797575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:31.798005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:31.798685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:31.799132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:31.799550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:31.932358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:31.940702 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5607c3e3-cf9f-4915-8d19-6f7a5d64a1f5 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1664 microversion: 2.1 time: 0.154470 Oct 10 17:11:31.941524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 198/407] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:31 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:32.441404 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:32.442248 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:32.450188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.450789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.451258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.452368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.452899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.453468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.710313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:32.719098 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cf760cb2-d2fb-4614-8a9a-f6547cb7eeba tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1502 microversion: 2.1 time: 0.281926 Oct 10 17:11:32.719701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 210/408] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:32 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:32.747771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8bc6087-8b79-4f03-8783-73e03fa9b01c"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:32.751039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:32.757227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.757715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.758181 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.758877 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.759329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.759756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.763596 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:32.783294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] HTTP exception thrown: Cannot 'attach_volume' instance e69da494-0060-4875-9dc0-625701fa03b5 while it is in vm_state rescued Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Request method failure captured: Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/os-volume_attachments HTTP/1.1 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 74 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFHaP_lc3vz9pgrbr-DamSLD-d3HOHVBLpjHCiyCjIguhunDS3fnRBPsADHg6KlRNQOXvQRCHj6ci73jrmYEQ9WPQLGeXAnQLLDV9UO3HknmTjCRIuaWVawfLRIq8dELcjq3qPqgtBaHSMDnnk63gpwJ2swvH4Y_yR6n9Zu5w2comVQ Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 2488f5601066432a8652433df5702119 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:11:32.785020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2488f5601066432a8652433df5702119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2488f5601066432a8652433df5702119"}]}] Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 2488f5601066432a8652433df5702119 Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 1e8d2e4a8a334eea973280b3819219e3 Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {"volumeAttachment": {"volumeId": "c8bc6087-8b79-4f03-8783-73e03fa9b01c"}} Oct 10 17:11:32.792707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Cannot 'attach_volume' instance e69da494-0060-4875-9dc0-625701fa03b5 while it is in vm_state rescued Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'server_id': 'e69da494-0060-4875-9dc0-625701fa03b5', 'body': {'volumeAttachment': {'volumeId': 'c8bc6087-8b79-4f03-8783-73e03fa9b01c'}}} Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e69da494-0060-4875-9dc0-625701fa03b5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:11:32.793464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e69da494-0060-4875-9dc0-625701fa03b5 while it is in vm_state rescued Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:11:32.794615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e69da494-0060-4875-9dc0-625701fa03b5 while it is in vm_state rescued Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Returning 409 to user: Cannot 'attach_volume' instance e69da494-0060-4875-9dc0-625701fa03b5 while it is in vm_state rescued {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6c331d1a-a64b-4003-9de1-e04ff86030ce tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043056 Oct 10 17:11:32.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 199/409] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:11:32 2022] POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 17:11:32.796712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:32.796816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:32.803096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.803583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.804048 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.804743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.805197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.805619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.965074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:32.965663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:32.972055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.972568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.973003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.973684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:32.974133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:32.974556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:32.994338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-eed15c97-81ed-4f58-8682-b408c4a2028c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/action" status: 202 len: 0 microversion: 2.1 time: 0.202487 Oct 10 17:11:32.994964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 211/410] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:11:32 2022] POST /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:11:33.005009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:33.006142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:33.014443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:33.014938 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:33.015469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:33.016222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:33.016836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:33.017305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:33.157336 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:33.166269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9baa398f-e1b3-4753-b380-3bc4f09c6654 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1664 microversion: 2.1 time: 0.205442 Oct 10 17:11:33.166949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 200/411] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:32 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1664 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:33.193434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:33.201099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cbd7f6dc-b971-4950-b18f-3ecc2ff9f5e2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1510 microversion: 2.1 time: 0.201622 Oct 10 17:11:33.201655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 212/412] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:32 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:34.190612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:34.191471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:34.197675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:34.198194 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:34.198711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:34.199837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:34.200614 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:34.201040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:34.226328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:34.227225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:34.235040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:34.235626 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:34.236161 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:34.236932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:34.237654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:34.238148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:34.547705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:34.557748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3214360d-8ab7-45eb-904e-488fccfdf3e9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1668 microversion: 2.1 time: 0.371611 Oct 10 17:11:34.557947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:34.572048 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 201/413] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:34 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1668 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:34.572238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-dd8c0247-39f6-4a1a-b0e9-f03df8a4a0ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1510 microversion: 2.1 time: 0.346310 Oct 10 17:11:34.572238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 213/414] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:34 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:11:35.589904 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:35.590521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:35.597080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:35.597568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:35.598007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:35.598695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:35.599152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:35.599579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:35.731074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:35.739571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f2040a9e-90a2-4068-be28-c9be333540b6 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1510 microversion: 2.1 time: 0.153521 Oct 10 17:11:35.740147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 202/415] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:35 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:36.763608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:36.765870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:36.770972 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:36.771457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:36.771909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:36.772634 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:36.773087 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:36.773509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:36.901677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:36.909902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-47b59b19-41de-4795-aad8-bf3df3663144 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1510 microversion: 2.1 time: 0.150154 Oct 10 17:11:36.910456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 214/416] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:36 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:37.933535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:37.934156 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:37.941376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:37.941858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:37.942296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:37.942981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:37.943433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:37.943857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:38.071626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:38.079230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bd49f68f-da13-477e-a80e-bfab18de13d9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1516 microversion: 2.1 time: 0.149566 Oct 10 17:11:38.079786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 203/417] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:37 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:39.672620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9b206be4-55e6-4b7f-b2ff-097959f6a530 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: .version_select at 0x7f34ef45a8b0>, body: {"keypair": {"name": "tempest-keypair-1760902907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtKW+EIvlhDnOoALeRUViYnMh7RyBj7yx5rlT+FB818WUg7ZNTVF30MkbjSxevfdUZoNzJibhcbE9qN4D0Rxyd6qz8KI798kdW+qqLkjfZhxoGQlbEH+p02WLU2UXAWWA=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:39.678843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:11:39.678998 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Mon Oct 10 17:11:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 10 17:11:39.693401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-9b206be4-55e6-4b7f-b2ff-097959f6a530 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for project 2488f5601066432a8652433df5702119. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:11:39.697171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-9b206be4-55e6-4b7f-b2ff-097959f6a530 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for user 1e8d2e4a8a334eea973280b3819219e3 and project 2488f5601066432a8652433df5702119. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:11:39.794286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9b206be4-55e6-4b7f-b2ff-097959f6a530 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125930 Oct 10 17:11:39.794884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 215/418] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:11:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:42.022484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1813393108", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86a27400-3c0a-470b-b156-cfefc1803bb5"}], "security_groups": [{"name": "tempest-securitygroup--1153219577"}], "key_name": "tempest-keypair-1760902907", "user_data": "}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:42.128892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] validate_networks() for [('86a27400-3c0a-470b-b156-cfefc1803bb5', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:11:42.508353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:11:42.508775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:11:42.509252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:11:42.509656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:11:42.510061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:11:42.518677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:42.519154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:42.519585 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:42.520331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:42.520779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:42.521195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:42.537300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:11:42.541174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Getting quotas for user 1e8d2e4a8a334eea973280b3819219e3 and project 2488f5601066432a8652433df5702119. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:11:42.552445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:11:42.554732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:11:42.714656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c02f8ccb-2c95-4730-8253-1d9a5906cbcd tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.696418 Oct 10 17:11:42.715285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 204/419] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:11:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:11:42.726797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f4834a22-64df-463e-8255-ddfc2c007131 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:42.727481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f4834a22-64df-463e-8255-ddfc2c007131 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:42.781758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f4834a22-64df-463e-8255-ddfc2c007131 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:42.788765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f4834a22-64df-463e-8255-ddfc2c007131 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1246 microversion: 2.1 time: 0.066314 Oct 10 17:11:42.789333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 216/420] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:42 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:43.812471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:43.813594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:43.820409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:43.820893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:43.821327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:43.822023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:43.822475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:43.822900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:43.885348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:43.893604 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d0ceb635-3f3c-4b92-824f-748a2e2ff0a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1250 microversion: 2.1 time: 0.085598 Oct 10 17:11:43.894164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 205/421] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:43 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:44.916872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:44.917566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:44.924630 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:44.925108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:44.925579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:44.926259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:44.926850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:44.927271 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:44.988175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:44.996596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4a57b877-e046-438d-aa01-4659f7e4b523 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1298 microversion: 2.1 time: 0.084223 Oct 10 17:11:44.997224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 217/422] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:44 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:46.020700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:46.021271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:46.028051 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:46.028541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:46.028974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:46.029660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:46.030109 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:46.030537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:46.244772 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:46.252625 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d75200e7-610a-4ea2-8e10-6592b176c405 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.236100 Oct 10 17:11:46.253200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 206/423] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:46 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:47.166793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:47.181045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:47.181045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:47.181045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:47.193015 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] Creating event network-changed:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:11:47.198711 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-854028c3-383e-4ac2-b6d0-0cb387ef7d28 req-6d783dd6-c038-49d6-be34-60bb56c2b858 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035669 Oct 10 17:11:47.200367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 218/424] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:47.276945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:47.279481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:47.284653 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:47.285079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:47.285492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:47.286433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:47.287083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:47.287681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:47.486647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:47.494371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7a4c1c59-55b0-4c0c-a763-d81751ac0608 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.221456 Oct 10 17:11:47.494930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 207/425] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:47 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:48.518376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:48.518962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:48.525583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:48.526056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:48.526488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:48.527170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:48.527615 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:48.528047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:48.655676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:48.663963 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7b596cf8-ad88-4307-8200-58977568ef54 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.150244 Oct 10 17:11:48.664574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 219/426] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:48 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:49.686707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:49.687310 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:49.690203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:49.695094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:49.695579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:49.696014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:49.696716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:49.697173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:49.697594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:49.825024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:49.833207 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-27ec927a-ac26-45bd-9d12-215efc8905d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.150353 Oct 10 17:11:49.833774 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 208/427] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:49 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:50.855607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:50.856263 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:50.863598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:50.864113 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:50.864550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:50.865248 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:50.865868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:50.866290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:50.992550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:51.000107 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6a86c6e8-7f34-4228-a036-398b7ba5a71f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.148358 Oct 10 17:11:51.000695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 220/428] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:50 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:52.023316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:52.023916 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:52.030496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:52.030972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:52.031402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:52.032134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:52.032637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:52.033057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:52.161025 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:52.168864 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9b49ee3c-e313-408f-99b5-35c09be1d61f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.149226 Oct 10 17:11:52.169285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 209/429] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:52 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:52.332335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "name": "network-vif-plugged", "status": "completed", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:52.337723 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:52.342879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:52.343354 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:52.343780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:52.354756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] Creating event network-vif-plugged:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:11:52.359748 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-8fa013d3-a417-43e4-bfc5-9c7b4fdfd22e req-2ce165ba-923a-4278-9388-5c6dc229df2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031155 Oct 10 17:11:52.360379 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 221/430] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:11:53.193018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:53.193621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:53.195472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:53.196172 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:53.201314 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:53.201795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:53.202224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:53.202901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:53.203346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:53.203764 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:53.333390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:53.340807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-969bb04b-d5c7-47dd-84f8-e44aae17f868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.151924 Oct 10 17:11:53.341364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 210/431] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:53 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:54.360538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=6 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:54.365193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:54.365918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:54.372386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:54.372867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:54.373325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:54.374008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:54.374458 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:54.374879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:54.506029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:54.513687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d75f90f7-c021-4643-9b1d-34daccb7db58 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1372 microversion: 2.1 time: 0.154049 Oct 10 17:11:54.514250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 222/432] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:54 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:55.536923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:55.537572 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:55.543988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:55.544530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:55.547536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:55.547536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:55.547536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:55.547536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:55.673061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:11:55.681241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-172fb963-f2f6-411c-b28a-8cbe7aee929b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1566 microversion: 2.1 time: 0.148708 Oct 10 17:11:55.681802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 211/433] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:11:55 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:11:55.703489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:11:55.703990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:11:55.710442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:55.710923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:55.711353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:55.712085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:55.712535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:55.712956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:55.729824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:11:55.789233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-beda6db3-7bad-4d2a-af15-471cde7f6e28 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089585 Oct 10 17:11:55.789842 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 223/434] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:11:55 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:11:56.744932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:11:56.755282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:11:56.755952 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:11:56.756422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:11:56.767017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] Creating event network-changed:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:11:56.772081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-e2e50b79-65dc-4ffd-8c9f-132d1d73cc34 req-2cc6c6a4-ed1d-4473-85a9-92d1d93fe722 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030725 Oct 10 17:11:56.772841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 212/435] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:16.934387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=5 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:16.938769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:16.939260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:16.948986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:16.948986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:16.948986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:16.948986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:16.949362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:16.949362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:16.978558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-43276e73-57ec-41a1-b575-26b54bc49781 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments/b5f17ff5-e617-476a-8700-ba174375f441" status: 200 len: 194 microversion: 2.20 time: 0.045858 Oct 10 17:12:16.979131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 224/436] 10.222.0.42 () {60 vars in 1454 bytes} [Mon Oct 10 17:12:16 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments/b5f17ff5-e617-476a-8700-ba174375f441 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:12:17.045099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=9 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:17.045825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=72 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:17.050881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:17.054768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:17.057505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:17.057987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:17.058449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:17.059137 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:17.059589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:17.060014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:17.187833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lazy-loading 'services' on Instance uuid 65073136-459b-4282-b371-c7bf0f7144d2 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:12:17.445985 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0044fd21-ff52-4937-b661-1ade50ed9ac5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments/b5f17ff5-e617-476a-8700-ba174375f441" status: 202 len: 0 microversion: 2.20 time: 0.402333 Oct 10 17:12:17.446609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 213/437] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Oct 10 17:12:17 2022] DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments/b5f17ff5-e617-476a-8700-ba174375f441 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:12:17.455402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:17.457705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:17.463787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:17.464291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:17.464727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:17.465423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:17.465894 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:17.466311 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:17.496355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2ca633dc-33ec-431c-b400-3bdea97eac1e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045288 Oct 10 17:12:17.496884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 225/438] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 10 17:12:17 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 17:12:18.510352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:18.512597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:18.518816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:18.519292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:18.519720 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:18.520428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:18.520870 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:18.521329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:18.551452 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-257e0bb5-6407-4c39-b0c3-7f3356cd1c58 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045918 Oct 10 17:12:18.552278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 214/439] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 10 17:12:18 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:12:19.564507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:19.567403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:19.573814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:19.574293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:19.574729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:19.575413 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:19.575865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:19.576317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:19.604861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d1090f89-53b9-4791-a6ef-c24ff091a6f9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044772 Oct 10 17:12:19.605408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 226/440] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 10 17:12:19 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:19.667467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:19.668330 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:19.674711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:19.675181 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:19.675609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:19.676323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:19.677028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:19.677455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:19.702485 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:12:19.981360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a2fc132a-02ec-4ee9-94ac-6497806c32b5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 204 len: 0 microversion: 2.20 time: 0.317415 Oct 10 17:12:19.982062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 215/441] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 10 17:12:19 2022] DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 17:12:19.990838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:19.991436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:19.999746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:19.999746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:19.999746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:19.999746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:20.000217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:20.000217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:20.133312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:20.141359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:20.142801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:20.143947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c3a3c9e6-f24b-4e3b-82d7-6cf9bc89607f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.157592 Oct 10 17:12:20.144521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 227/442] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:19 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:21.169790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:21.170476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:21.176817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:21.177297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:21.177725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:21.178440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:21.178887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:21.179301 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:21.305122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:21.313026 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:21.314453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:21.315597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-dabf9ced-547a-4b3f-a6b3-a69c6ec4d5b1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.150131 Oct 10 17:12:21.317029 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 216/443] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:21 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:22.341526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:22.342161 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:22.349257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.349734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.350162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.350848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.351291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.351706 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.580735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:22.582775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:22.585373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:22.589827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:22.591289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:22.591836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.592361 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.592492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ec2c378f-2cd8-4516-a0f3-94305c9c4ae0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1723 microversion: 2.20 time: 0.254870 Oct 10 17:12:22.592803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.605747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 228/444] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:22 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:22.605943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.605943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.605943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.629589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ff625a43-87e5-4c57-9aa7-747bb7964839 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051567 Oct 10 17:12:22.630174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 217/445] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:12:22 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 17:12:22.697160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:22.697804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:22.703994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.704523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.704952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.705646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.706094 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.706511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.734569 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:12:22.975502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-344742b8-e93a-448f-9200-b2920ededec1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 204 len: 0 microversion: 2.1 time: 0.282029 Oct 10 17:12:22.976103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 229/446] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:12:22 2022] DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:12:22.984164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:22.984843 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:22.991174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.991799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.992187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:22.992896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:22.993380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:22.993846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:23.227512 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:23.235922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c713436e-dacf-4a8b-aa51-9e2a73bf0c86 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1674 microversion: 2.1 time: 0.255371 Oct 10 17:12:23.236451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 218/447] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:22 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:23.405365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65073136-459b-4282-b371-c7bf0f7144d2", "name": "network-vif-deleted", "tag": "bb02af33-ad9f-40d4-b884-6043f298eaeb"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:23.416125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:23.416610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:23.417036 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:23.429586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] Creating event network-vif-deleted:bb02af33-ad9f-40d4-b884-6043f298eaeb for instance 65073136-459b-4282-b371-c7bf0f7144d2 on hv-cinder-83454 Oct 10 17:12:23.434526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-544bc561-5c05-47ae-89a0-576bee37d615 req-ba37fdac-129c-4303-95fe-d3baca345ae8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Oct 10 17:12:23.435126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 230/448] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:23.619259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:23.619788 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:23.626348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:23.627031 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:23.627657 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:23.628578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:23.629393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:23.629822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:23.692718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:23.700884 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:23.702324 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:23.703472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b229fa0d-424f-456f-abe4-d7e3b3d45878 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1656 microversion: 2.20 time: 0.088599 Oct 10 17:12:23.704048 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 219/449] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:23 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:24.261144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:24.261840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:24.268114 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:24.268606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:24.269041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:24.270296 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:24.270753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:24.271177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:24.405112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:24.413824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8f6d32a2-0525-4511-8656-02f1970c9f89 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1674 microversion: 2.1 time: 0.156897 Oct 10 17:12:24.428677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 231/450] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:24 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:24.730225 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:24.730747 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:24.737138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:24.737612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:24.738667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:24.739346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:24.739788 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:24.740235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:24.803404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:24.811754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:24.813248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:24.814415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3b4c80ae-4696-40ee-84cf-3314bf6745ec tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1656 microversion: 2.20 time: 0.088744 Oct 10 17:12:24.814966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 220/451] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:24 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:25.437505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:25.438040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:25.444976 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:25.446632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:25.446632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:25.446632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:25.447059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:25.447518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:25.654901 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:25.663575 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-72ec0811-d9a7-44a0-a9d0-e093a7eca1b1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1674 microversion: 2.1 time: 0.230031 Oct 10 17:12:25.676047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 232/452] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:25 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:25.840074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:25.840799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:25.847151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:25.847662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:25.848113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:25.848823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:25.849288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:25.849704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:25.882946 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:25.883423 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:25.883850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:25.884321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lazy-loading 'fault' on Instance uuid 65073136-459b-4282-b371-c7bf0f7144d2 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:12:25.956012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:25.964575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:25.966292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:25.967437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a050b385-3551-4f0b-9270-6b882872ad29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 200 len: 1372 microversion: 2.20 time: 0.131589 Oct 10 17:12:25.967982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 221/453] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:25 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:26.452011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83890954-0bab-4582-a1a0-46ba1a3d846e", "name": "network-vif-deleted", "tag": "ee17d066-205b-40da-b2ab-8a810dbe5020"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:26.464608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:26.465079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:26.465510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:26.476759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] Creating event network-vif-deleted:ee17d066-205b-40da-b2ab-8a810dbe5020 for instance 83890954-0bab-4582-a1a0-46ba1a3d846e on hv-cinder-83454 Oct 10 17:12:26.482097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-79aaeb8e-f304-497a-a2c4-836cfefa08f6 req-8c7cbe56-c3ed-472d-bd5d-e9d335c71666 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033775 Oct 10 17:12:26.482768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 233/454] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:26.686728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:26.687380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:26.693567 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:26.694056 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:26.694483 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:26.695163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:26.695607 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:26.696040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:26.757871 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:26.765940 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1a05f53e-b6c3-4e42-aa43-87b9895a9544 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 200 len: 1323 microversion: 2.1 time: 0.083010 Oct 10 17:12:26.766513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 222/455] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:26 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 1323 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:26.994423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:26.995257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:27.001968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:27.002524 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:27.003022 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:27.004330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:27.004764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:27.005242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:27.020976 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 HTTP/1.1 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:12:27.022621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:12:27.024125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '65073136-459b-4282-b371-c7bf0f7144d2'} Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:12:27.025193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:12:27.027124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.028712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:12:27.028712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef214990-8cdf-4251-a163-7ac19f993fe0 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 404 len: 111 microversion: 2.20 time: 0.034901 Oct 10 17:12:27.028712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 234/456] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:26 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:12:27.033029 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2ffe34b4-b9f9-480e-a711-750df5c09a47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '.version_select at 0x7f34ef3d0a60>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:27.099305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2ffe34b4-b9f9-480e-a711-750df5c09a47 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185581588" status: 204 len: 0 microversion: 2.20 time: 0.070016 Oct 10 17:12:27.100557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 223/457] 10.222.0.42 () {60 vars in 1262 bytes} [Mon Oct 10 17:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185581588 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 17:12:27.794264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:27.794946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:27.801631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:27.802110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:27.802535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:27.803217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:27.803657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:27.804091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:27.817805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e HTTP/1.1 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:12:27.819304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:12:27.820911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '83890954-0bab-4582-a1a0-46ba1a3d846e'} Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:12:27.821823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:12:27.822945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:12:27.823968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:12:27.823968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-23e87ec2-fee6-44b1-afe3-2abf263f3290 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 404 len: 111 microversion: 2.1 time: 0.033913 Oct 10 17:12:27.823968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:27 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:12:27.829494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8b075531-85d9-4d62-bb4e-5582b41e058c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '.version_select at 0x7f34ef43aa60>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:27.893432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8b075531-85d9-4d62-bb4e-5582b41e058c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098437952" status: 202 len: 0 microversion: 2.1 time: 0.067655 Oct 10 17:12:27.894017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 224/459] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 10 17:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098437952 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:12:27.894993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e93602f6-f07d-47c3-8d03-004c06e45015 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: .version_select at 0x7f34ef7f93a0>, body: {"keypair": {"name": "tempest-keypair-1603877069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp3AzV9bGvw3hBeCiyjB2wyRiikKceBkC4gTd0BQL/NaKejcMMuPTyOU/ZCOuR/aS6+HQaLUN8Y3PSsUQKEQBKlj+S7x3pKbWl6DDEJ7qbak0semQ2wKykHWmnkxG4QpQ=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:27.912299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-e93602f6-f07d-47c3-8d03-004c06e45015 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for project 34f584f725354f68b917b45b645b3630. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:12:27.916116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-e93602f6-f07d-47c3-8d03-004c06e45015 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for user b8507de448b6455fb792bda0c949421d and project 34f584f725354f68b917b45b645b3630. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:12:27.996795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e93602f6-f07d-47c3-8d03-004c06e45015 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.105587 Oct 10 17:12:27.997390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 236/460] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Oct 10 17:12:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 10 17:12:28.651407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c712869b-fefd-421c-84ce-ab696099c5f6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: .version_select at 0x7f34ef4a1940>, body: {"keypair": {"name": "tempest-keypair-943984720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKpCK3oiADGyDO8pyTTN5Qq4E5aSuRMmZ1ED/lET68osMXbfcwG4qOFwoP7Y7aWKKcSJUUaQUB9wwRg2PYpv6JUvpWcW3zJNTrcC00wf+tjthrOtQlqyDvCuS90VHb1Ag=="}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:28.666715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-c712869b-fefd-421c-84ce-ab696099c5f6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for project 18aef1375628417b91f816bccd05d1cf. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:12:28.670776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-c712869b-fefd-421c-84ce-ab696099c5f6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for user 8bb27ad53d4a454eb10268ab27ad3258 and project 18aef1375628417b91f816bccd05d1cf. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:12:28.744618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c712869b-fefd-421c-84ce-ab696099c5f6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097672 Oct 10 17:12:28.745209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 225/461] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:12:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:30.339125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-219260009", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "710e1b7f-f37c-4711-979b-caac1afb6b90"}], "security_groups": [{"name": "tempest-securitygroup--865971918"}], "key_name": "tempest-keypair-1603877069", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:30.445273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] validate_networks() for [('710e1b7f-f37c-4711-979b-caac1afb6b90', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:12:30.815893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:12:30.815893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:12:30.815893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:12:30.816192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:12:30.816851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:12:30.825702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:30.826167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:30.826783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:30.827505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:30.827953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:30.828398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:30.844673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for project 34f584f725354f68b917b45b645b3630. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:12:30.849045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Getting quotas for user b8507de448b6455fb792bda0c949421d and project 34f584f725354f68b917b45b645b3630. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:12:30.859730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:12:30.862065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:12:31.015811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8349a985-ae63-40b7-8e98-348389eeffc5 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.680931 Oct 10 17:12:31.016690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 237/462] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Oct 10 17:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 17:12:31.028412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:31.029019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:31.087613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1210559366", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0eee5d35-4847-4982-a7a4-935838222131"}], "security_groups": [{"name": "tempest-securitygroup--676225863"}], "key_name": "tempest-keypair-943984720", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:31.088066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:31.095957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:31.098775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:31.099094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5bd6d202-470e-41c3-879a-a012a2dc6d71 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1281 microversion: 2.20 time: 0.075150 Oct 10 17:12:31.099641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 226/463] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:31 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:31.196916 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] validate_networks() for [('0eee5d35-4847-4982-a7a4-935838222131', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:12:31.788757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:12:31.789320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:12:31.789634 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:12:31.790037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:12:31.790442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:12:31.798973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:31.803978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:31.803978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:31.803978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:31.803978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:31.804372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:31.818708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for project 18aef1375628417b91f816bccd05d1cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:12:31.822826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Getting quotas for user 8bb27ad53d4a454eb10268ab27ad3258 and project 18aef1375628417b91f816bccd05d1cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:12:31.833757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:12:31.836080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:12:31.940003 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-06845f1d-c073-4f8c-a534-58f2767786eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.856802 Oct 10 17:12:31.940836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 238/464] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:12:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:12:31.952402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-05c0cefa-0443-4814-be79-a670b49b1525 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:31.953029 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-05c0cefa-0443-4814-be79-a670b49b1525 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:32.009046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-05c0cefa-0443-4814-be79-a670b49b1525 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:32.016060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-05c0cefa-0443-4814-be79-a670b49b1525 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1237 microversion: 2.1 time: 0.067553 Oct 10 17:12:32.016641 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 227/465] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:31 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:32.124868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:32.126520 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:32.132155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:32.132701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:32.133131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:32.133814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:32.134254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:32.134669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:32.195985 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:32.204321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:32.205698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:32.206796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3927f68c-e93c-498e-8b59-d3dd4d0a1571 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1285 microversion: 2.20 time: 0.085818 Oct 10 17:12:32.207559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 239/466] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:32 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:33.038715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:33.039251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:33.045647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:33.046131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:33.049771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:33.049771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:33.049771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:33.049771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:33.108851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:33.116376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fe0f56b8-4600-406b-84bf-561b5e0cf2d3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1241 microversion: 2.1 time: 0.081556 Oct 10 17:12:33.120599 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 228/467] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:33 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:33.232767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:33.233367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:33.240189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:33.240710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:33.241150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:33.241919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:33.242398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:33.242823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:33.307276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:33.315554 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:33.317613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:33.321305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-16ecdfd0-ee71-4b97-9e11-268d041dbff3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1333 microversion: 2.20 time: 0.090000 Oct 10 17:12:33.321305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 240/468] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:33 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:34.140351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:34.141639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:34.147908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:34.148447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:34.148879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:34.149583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:34.150107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:34.150699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:34.214934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:34.223398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3b08061a-6d19-4a9e-b7bf-efb04beef75a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1289 microversion: 2.1 time: 0.087260 Oct 10 17:12:34.223993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 229/469] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:34 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:12:34.344402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:34.345182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:34.352246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:34.352971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:34.353909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:34.354953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:34.355625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:34.356305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:34.599797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:34.618593 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:34.620610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:34.623432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0785ce84-686d-40ca-947f-652245dfa055 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.281887 Oct 10 17:12:34.630456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 241/470] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:34 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:35.247578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:35.248832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:35.255725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:35.258635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:35.258635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:35.258635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:35.258635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:35.258962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:35.298849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:35.310405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:35.311141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:35.311729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:35.325667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] Creating event network-changed:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:12:35.333402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-cfadc2c1-50f7-4b40-93ae-6fcaa2ec0799 req-cf488a56-344b-4f6c-82b0-a67b9a19b527 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038240 Oct 10 17:12:35.334863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 242/471] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:12:35.376703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:35.396215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-48848834-41d2-4c6e-979f-bb481662eae1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1295 microversion: 2.1 time: 0.153310 Oct 10 17:12:35.397373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 230/472] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:35 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1295 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:35.651408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:35.652119 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:35.658190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:35.658996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:35.659118 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:35.659733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:35.660194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:35.660618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:35.897429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:35.908616 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:35.910271 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:35.911393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-053dff99-e7fd-4027-ae33-d00c48836f29 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.264800 Oct 10 17:12:35.916525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 243/473] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:35 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:36.420149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:36.420527 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:36.427683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:36.431034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:36.431034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:36.431034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:36.431034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:36.431601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:36.568552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:36.571996 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:36.576591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a4fe9b43-e25e-4664-a01a-9e79592c1ac6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.160812 Oct 10 17:12:36.577155 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 231/474] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:36 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:36.689542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59278b05-38e3-4729-aa7f-c7b3b9bd056d", "tag": "05d674f5-f8de-4695-bd75-1646219b71d5"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:36.700126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:36.700596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:36.701060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:36.712374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] Creating event network-changed:05d674f5-f8de-4695-bd75-1646219b71d5 for instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d on hv-cinder-83454 Oct 10 17:12:36.718175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-ede7242c-b239-46a7-a9b4-2570ee19c1bd req-6e5ac82a-dd02-4d8f-aa8e-fc9439d15d27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Oct 10 17:12:36.718765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 244/475] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:12:36.937226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:36.937842 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:36.944926 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:36.945415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:36.945853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:36.946545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:36.947002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:36.947427 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:37.075077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:37.082983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:37.084472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:37.085564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a4763f42-b060-4a5e-8937-8c9666f53938 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.152663 Oct 10 17:12:37.086113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 232/476] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:36 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:37.601508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:37.602210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:37.608317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:37.608803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:37.609247 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:37.609962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:37.610416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:37.610841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:37.616336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:37.744653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:37.752525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cd339d09-d814-4fa4-8ec8-b6dbe3ecdaee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.156032 Oct 10 17:12:37.753134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 245/477] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:37 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:38.110022 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:38.110605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:38.117012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:38.117494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:38.117931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:38.118672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:38.119124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:38.119547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:38.259023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:38.267085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:38.268676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:38.270353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a8727405-a6c2-40ee-a6d8-0da4dfe39978 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.164408 Oct 10 17:12:38.270909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 233/478] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:38 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:38.776010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:38.776582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:38.783120 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:38.783603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:38.784165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:38.784861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:38.785308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:38.785753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:38.911881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:38.919576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7440d116-287e-4e99-a9ed-a9147c17894c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.147493 Oct 10 17:12:38.920148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 246/479] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:38 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:39.294816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:39.295419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:39.302502 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:39.302918 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:39.303346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:39.304035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:39.304496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:39.304911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:39.431890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:39.439933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:39.441432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:39.442825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f808a9f9-c6a8-494f-bef3-b961a46e1ffc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.151889 Oct 10 17:12:39.443375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 234/480] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:39 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:39.943041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:39.943646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:39.949977 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:39.950460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:39.950897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:39.951580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:39.952045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:39.952472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.081424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:40.089603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d1db5ef2-0d4b-4393-8979-e6bda6b1d6c1 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.150695 Oct 10 17:12:40.090157 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 247/481] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:39 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:40.171928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d25be1e-e22a-45e7-9a42-5d3e361ce132"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:40.174357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:40.181273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:40.181759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:40.182190 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.182875 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:40.183326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:40.183746 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.467851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:40.469870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:40.474356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:40.474838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:40.475264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.475956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:40.476437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:40.476861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.620462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:40.629105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:40.630552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:40.631660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c3845d19-b6c7-4df4-b0ff-6a893b6fc35c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.167756 Oct 10 17:12:40.632243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 248/482] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:40 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:12:40.716443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:40.722541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:40.726251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:40.726726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:40.727153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:40.738416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] Creating event network-vif-plugged:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:12:40.743400 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-ba7122a2-7195-4384-8dd3-b8af1f7106c4 req-22de0b5c-e4a4-4c7d-a496-3dfc568ccef8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Oct 10 17:12:40.743980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 249/483] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:12:40.902132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ce6c6f90-59b2-45da-be45-83f2d4269fa1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733944 Oct 10 17:12:40.903031 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 235/484] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:12:40 2022] POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:41.115478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:41.118276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:41.122287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:41.122779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:41.123416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:41.124207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:41.124822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:41.125419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:41.270810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:41.278330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-85717150-1274-456c-9eda-e764be852310 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.169269 Oct 10 17:12:41.278888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 250/485] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:41 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:41.658765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:41.659458 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:41.667237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:41.677773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:41.677773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:41.677773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:41.677773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:41.678171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:41.797525 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:41.807450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:41.807450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:41.808577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-faab9e7e-e7b6-48b7-b1ce-d0ad4446b297 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1406 microversion: 2.20 time: 0.154600 Oct 10 17:12:41.809129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 236/486] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:41 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:42.302670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:42.303244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:42.305115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:42.305769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=16 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:42.312218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:42.312709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:42.313145 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:42.313840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:42.314300 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:42.314720 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:42.452647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:42.460698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-180dcb3e-f0f5-4654-aa8e-43964c794cc7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.163203 Oct 10 17:12:42.465285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 251/487] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:42 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:42.761840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59278b05-38e3-4729-aa7f-c7b3b9bd056d", "name": "network-vif-plugged", "status": "completed", "tag": "05d674f5-f8de-4695-bd75-1646219b71d5"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:42.767021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=8 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:42.773626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:42.778285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:42.778285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:42.785445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] Creating event network-vif-plugged:05d674f5-f8de-4695-bd75-1646219b71d5 for instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d on hv-cinder-83454 Oct 10 17:12:42.790290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-07b80a51-4923-4354-b1bb-caa29d763f4e req-0e6937b5-4ef8-42c4-b216-10cb078f2a6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032220 Oct 10 17:12:42.790859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 237/488] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:42.834265 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:42.834865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:42.840726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:42.841215 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:42.841651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:42.842359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:42.842809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:42.843227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:42.978099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:42.986295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:42.987715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:42.988902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-34220a54-e760-4048-a0c4-7f041b43db1d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1599 microversion: 2.20 time: 0.159099 Oct 10 17:12:42.989428 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 252/489] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:12:42 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:12:43.014842 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:43.015407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:43.022584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:43.023057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:43.023485 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:43.024197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:43.024682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:43.025096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:43.108288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ef0107d1-d106-479f-8590-364ccbb431cd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097950 Oct 10 17:12:43.108869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 238/490] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Oct 10 17:12:43 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:12:43.484596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:43.485118 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:43.492190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:43.492672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:43.493144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:43.493810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:43.494252 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:43.494663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:43.657574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:43.665585 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-35b6dd36-b3b5-4f5e-8a66-f44ae2be4527 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.185012 Oct 10 17:12:43.666134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 253/491] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:43 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:44.335372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:44.344535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:44.345007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:44.345426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:44.356306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] Creating event network-changed:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:12:44.361233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-ae797864-b536-4b6f-821f-e722ba079ca4 req-08fbb671-e985-488f-9447-bb7be4c57a19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030558 Oct 10 17:12:44.361815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 239/492] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:44.689189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:44.689816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:44.697074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:44.697560 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:44.697999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:44.698686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:44.699137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:44.699558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:44.835881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:44.843807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d5c55749-bea8-4348-b448-890032ea4fab tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1362 microversion: 2.1 time: 0.158394 Oct 10 17:12:44.844411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 254/493] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:44 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:45.867889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:45.868640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:45.874840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:45.875319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:45.875748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:45.876457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:45.876932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:45.877361 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:46.008298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:46.015932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b3a39152-2641-4ca4-b413-726499b6a5ae tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1548 microversion: 2.1 time: 0.152781 Oct 10 17:12:46.016528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 240/494] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:45 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:46.038892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:46.039386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:46.045802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:46.046278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:46.046705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:46.047375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:46.047818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:46.048351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:46.123532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a3d67c8c-3fb8-42fc-8b1a-486b3104a904 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088753 Oct 10 17:12:46.124142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 255/495] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:12:46 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:47.101561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59278b05-38e3-4729-aa7f-c7b3b9bd056d", "tag": "05d674f5-f8de-4695-bd75-1646219b71d5"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:47.111295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:47.111763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:47.112225 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:47.123933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] Creating event network-changed:05d674f5-f8de-4695-bd75-1646219b71d5 for instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d on hv-cinder-83454 Oct 10 17:12:47.129450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-aa89a1fb-8563-41b7-8df7-9f86a6ac409f req-3d58e6e4-c75d-4c84-8af9-fae01a64babf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030954 Oct 10 17:12:47.130028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 241/496] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:12:48.454260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:12:48.458550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:48.464334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:48.464941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:48.465380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:48.466076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:48.466523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:48.466943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:48.490821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'flavor' on Instance uuid 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:12:48.793409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-492cb7cc-30e5-4212-8ab6-e7d41ce9bdd2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/action" status: 200 len: 32 microversion: 2.1 time: 0.343445 Oct 10 17:12:48.794013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 256/497] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:12:48 2022] POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:12:48.803964 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:48.804688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:48.808391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:48.811864 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:48.812363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:48.812797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:48.813511 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:48.813957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:48.814372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:48.945143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:48.955708 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6daa2c95-3a50-4483-aa8f-7f40b79e4b30 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.155075 Oct 10 17:12:48.956227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 242/498] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:48 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:49.978364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:49.979053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:49.985915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:49.986391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:49.986820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:49.987495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:49.988483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:49.988988 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:50.119238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:50.127493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5efcfa72-b136-453b-8153-193f52fabcc4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.153373 Oct 10 17:12:50.128066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 257/499] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:49 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:51.151901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:51.152479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:51.158798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:51.159272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:51.159700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:51.160416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:51.160866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:51.161297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:51.286751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:51.294829 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d6dd6ee0-dd07-42b9-a86e-a465b905b6b9 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.147228 Oct 10 17:12:51.295395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 243/500] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:51 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:52.318773 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:52.319374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:52.326270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:52.326747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:52.327178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:52.327851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:52.328327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:52.328743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:52.455612 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:52.464209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-21164ea5-bccc-40c4-af4f-3fd9479f6d41 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.149590 Oct 10 17:12:52.464770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 258/501] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:52 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:53.487756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:53.488399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:53.494878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:53.495358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:53.495791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:53.496508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:53.496959 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:53.497379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:53.624366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:53.632941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-41a38966-2338-4719-b0de-1c88de802d02 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.149000 Oct 10 17:12:53.633500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 244/502] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:53 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:54.656789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:54.657390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:54.663192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:54.663676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:54.664135 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:54.664808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:54.665251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:54.665664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:54.794134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:54.802189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-32e5ef7f-f91e-43e1-997a-741a6958b344 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.149428 Oct 10 17:12:54.802738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 259/503] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:54 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:55.826035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:55.826595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:55.833004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:55.833478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:55.833903 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:55.834574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:55.835019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:55.835450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:55.963855 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:55.971941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4d967a96-3659-4134-b09e-bd1a9a50f46c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.149771 Oct 10 17:12:55.972523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 245/504] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:55 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:56.996398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:56.997006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:57.003391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:57.003870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:57.004340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:57.005031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:57.005478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:57.005904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:57.134933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:57.138444 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:12:57.143504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-05f260c0-f18c-48fc-937b-02da4a8c0e7a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.151061 Oct 10 17:12:57.144074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 260/505] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:56 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:58.166853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:58.167497 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:58.173953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:58.177856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:58.177856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:58.177856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:58.177856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:58.178236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:58.306385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:58.314636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-564037f2-864a-419e-a8f4-712394aad637 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.151922 Oct 10 17:12:58.315191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 246/506] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:58 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:12:59.339217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:12:59.339820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:12:59.346785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:59.347261 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:59.347692 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:59.348407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:12:59.348852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:12:59.349273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:12:59.474765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:12:59.483508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c06b06fd-a035-4044-8e7d-63b2340ad28f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.148714 Oct 10 17:12:59.484077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 261/507] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:12:59 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:00.506834 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:00.507439 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:00.514071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:00.514549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:00.514975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:00.515654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:00.516145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:00.516630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:00.648528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:00.656514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e3d298cd-247c-4fde-b136-3fea2c96cb4e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.153779 Oct 10 17:13:00.657063 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 247/508] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:00 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:01.680113 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:01.680727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:01.687037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:01.687520 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:01.688648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:01.688648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:01.689106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:01.689528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:01.819168 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:01.828790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3ca6b963-ac06-4623-b4d1-567e72ee5e7b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.152530 Oct 10 17:13:01.829352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 262/509] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:01 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:02.852509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:02.853109 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:02.859500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:02.859981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:02.860442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:02.861127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:02.861572 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:02.861990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:02.987152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:02.995710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bfeb4cea-81c9-434e-b923-af31c9e577d1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.147015 Oct 10 17:13:02.996292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 248/510] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:02 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:04.019044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:04.019643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:04.027181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:04.027673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:04.028147 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:04.028846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:04.029304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:04.029729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:04.157277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:04.165376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-09435f1f-7cef-4b20-93a1-d02c6f46bd7e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.150126 Oct 10 17:13:04.165941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 263/511] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:04 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:05.188216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:05.188847 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:05.195499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:05.195977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:05.196426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:05.197097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:05.197574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:05.197989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:05.215469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:05.323771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:05.331846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9ddb9029-2628-48bb-bf3d-3fe9f4a4707e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.147477 Oct 10 17:13:05.332443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 249/512] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:05 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:06.355851 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:06.356490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:06.362892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:06.363377 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:06.363818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:06.364536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:06.364992 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:06.365417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:06.648744 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:06.656826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7458afce-61eb-4490-a428-2db120f6eb3c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.304890 Oct 10 17:13:06.657382 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 264/513] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:06 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:07.680544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:07.681151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:07.687535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:07.688015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:07.688472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:07.689170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:07.689610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:07.690033 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:07.866768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:07.876901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-19a1ae7c-eba9-4d81-b245-03788cb37bff tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.200204 Oct 10 17:13:07.877469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 250/514] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:07 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:08.901395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:08.902032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:08.908420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:08.908901 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:08.909331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:08.910031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:08.910465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:08.910886 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:09.040370 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:09.048534 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-240eb3f5-648e-4387-b14e-9b077e329ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.151569 Oct 10 17:13:09.049096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 265/515] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:08 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:10.072207 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:10.072854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:10.079210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:10.079687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:10.080164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:10.080851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:10.081300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:10.081720 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:10.212147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:10.220508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-60bc1cfb-f598-48ae-a803-3b81c949b3fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.152263 Oct 10 17:13:10.221068 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 251/516] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:10 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:11.244338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:11.244943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:11.251236 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:11.251717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:11.252181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:11.252862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:11.253309 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:11.253733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:11.378233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:11.386939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-503d725a-056e-4670-a7c6-0219923551ac tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.146943 Oct 10 17:13:11.387510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 266/517] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:11 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:12.410552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:12.411142 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:12.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:12.418200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:12.418629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:12.419386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:12.419836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:12.420281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:12.547515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:12.555609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ba17e32b-8fbe-43ab-890e-ee18176ac373 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1737 microversion: 2.1 time: 0.148987 Oct 10 17:13:12.556184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 252/518] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:12 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:13.580399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:13.581006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:13.583226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=35 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:13.588581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.589063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.589491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:13.590175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.590617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.591034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:13.716863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:13.725261 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a7ccea33-fbac-4adb-9d92-d27e9541e73b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1717 microversion: 2.1 time: 0.148683 Oct 10 17:13:13.726463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 267/519] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:13 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:13.831907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:13.832419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:13.839224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.839697 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.840157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:13.840862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.841313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.841730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:13.923033 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] HTTP exception thrown: Cannot 'detach_volume' instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 while it is in vm_state rescued Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Request method failure captured: Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments/9d25be1e-e22a-45e7-9a42-5d3e361ce132 HTTP/1.1 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFHaP_lc3vz9pgrbr-DamSLD-d3HOHVBLpjHCiyCjIguhunDS3fnRBPsADHg6KlRNQOXvQRCHj6ci73jrmYEQ9WPQLGeXAnQLLDV9UO3HknmTjCRIuaWVawfLRIq8dELcjq3qPqgtBaHSMDnnk63gpwJ2swvH4Y_yR6n9Zu5w2comVQ Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 2488f5601066432a8652433df5702119 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:13:13.924691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2488f5601066432a8652433df5702119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2488f5601066432a8652433df5702119"}]}] Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 2488f5601066432a8652433df5702119 Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 1e8d2e4a8a334eea973280b3819219e3 Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:13:13.926243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Cannot 'detach_volume' instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 while it is in vm_state rescued Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'server_id': '4a1ca6a7-ee6c-4017-89c8-2a9cf2909847', 'id': '9d25be1e-e22a-45e7-9a42-5d3e361ce132'} Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:13:13.926999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 while it is in vm_state rescued Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 while it is in vm_state rescued Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:13.928320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Returning 409 to user: Cannot 'detach_volume' instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 while it is in vm_state rescued {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:13:13.929386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-68e9dd8a-43f4-48d0-8f09-6562dee44eca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments/9d25be1e-e22a-45e7-9a42-5d3e361ce132" status: 409 len: 152 microversion: 2.1 time: 0.098247 Oct 10 17:13:13.929386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 253/520] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:13:13 2022] DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments/9d25be1e-e22a-45e7-9a42-5d3e361ce132 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 17:13:13.934806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:13.935335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:13.941175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.941649 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.942082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:13.943030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:13.943481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:13.943904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:14.129384 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b4d9256e-bcfd-4d93-828a-3e190380368d tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/action" status: 202 len: 0 microversion: 2.1 time: 0.198064 Oct 10 17:13:14.130110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 268/521] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:13:13 2022] POST /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:13:14.139328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:14.139930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:14.145902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:14.146419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:14.146849 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:14.148065 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:14.148608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:14.149028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:14.276570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:14.284908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2596b9ce-4906-41d2-995d-181e0dad3d9c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1725 microversion: 2.1 time: 0.149562 Oct 10 17:13:14.285470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 254/522] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:14 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:15.310108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:15.310808 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:15.316868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:15.317351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:15.318056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:15.318736 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:15.319188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:15.319607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:15.449228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:15.457785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3ecdcece-ef74-4709-ba05-10db5058d8be tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1725 microversion: 2.1 time: 0.152362 Oct 10 17:13:15.458341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 269/523] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:15 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:16.480983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:16.481533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:16.487945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:16.488461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:16.488898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:16.489584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:16.490036 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:16.490457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:16.618003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:16.626353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b826e3c4-80af-4360-a469-c115d22b09a4 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1725 microversion: 2.1 time: 0.149178 Oct 10 17:13:16.626920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 255/524] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:16 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:17.650731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:17.651331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:17.657807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:17.658287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:17.658717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:17.659391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:17.659836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:17.660281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:17.790090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:17.798170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c1fbb28d-ae86-459a-9365-3c57951d84e3 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1731 microversion: 2.1 time: 0.151883 Oct 10 17:13:17.798726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 270/525] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:17 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:17.821280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:17.821756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:17.828183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:17.828667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:17.829108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:17.829821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:17.830272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:17.830695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:17.906373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-af55f356-ad65-459b-a52a-ef15fdd5a7ca tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089619 Oct 10 17:13:17.906965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 256/526] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:13:17 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:19.046793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:19.059932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:19.060447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:19.060914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:19.072412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] Creating event network-changed:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:13:19.077193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-c4b8ca8b-6c81-45c6-918e-451b36ca22eb req-0ab99e1a-b21c-4922-9cdf-b54c6dde554e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Oct 10 17:13:19.077783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 271/527] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:20.518688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:20.519174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:20.525055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:20.525534 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:20.525962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:20.526675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:20.527108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:20.527525 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:20.550193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-252b9883-307a-483c-8634-aa0c2c8f020c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.087454 Oct 10 17:13:20.550731 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 257/528] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Oct 10 17:13:20 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/ips => generated 152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:13:21.093852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:21.104172 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:21.104646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:21.105076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:21.115599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] Creating event network-changed:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:13:21.120486 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-af8645f3-66c8-4012-902a-e2c23c4b7ba0 req-9a4909de-9580-4730-8fdd-a19dd99fef98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031359 Oct 10 17:13:21.121059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 272/529] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:13:23.146910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:23.147497 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:23.154089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.154571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.155001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.155683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.156160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.156582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.181672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lazy-loading 'flavor' on Instance uuid e7fbb112-41b5-47f4-9c56-50fbd9bce1ef {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:23.182562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:23.183303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:23.186155 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=32 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:23.189486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.189969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.190404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.191093 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.191540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.191961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.215598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7c4b2dac-e986-4a7b-969d-a869a3b95c56 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/ips" status: 200 len: 146 microversion: 2.1 time: 0.089847 Oct 10 17:13:23.216186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 258/530] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:13:23 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/ips => generated 146 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:23.651484 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-21156053-c452-4a2f-9205-60e781bdf09d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/action" status: 202 len: 0 microversion: 2.20 time: 0.509567 Oct 10 17:13:23.652177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 273/531] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 10 17:13:23 2022] POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:13:23.660287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:23.661002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:23.667241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.667728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.668199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.668887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:23.669335 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:23.669752 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:23.804917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:23.812818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:23.814244 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:23.815396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1f02df0d-787e-4e64-af85-b06fbdb12259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.159022 Oct 10 17:13:23.815934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 259/532] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:23 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:24.841688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2e129f4-76bd-471b-a570-ed01d2203b26"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:24.842453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:24.843144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:24.844195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:24.849385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:24.849875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:24.850304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:24.850605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:24.850990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:24.851444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:24.851583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:24.851906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:24.852138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:24.853217 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:24.853717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:24.854141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:24.986197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:24.994927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:24.996395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:24.997538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-017c8262-9167-4861-8adb-9d6e5ea5171c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.159998 Oct 10 17:13:24.998300 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 274/533] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:24 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:25.518411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-abe264ca-ddb3-42ac-8965-08aa2f989597 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680554 Oct 10 17:13:25.519078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 260/534] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:13:24 2022] POST /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:26.024520 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:26.027429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:26.031934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:26.032481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:26.033295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:26.033964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:26.034438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:26.034854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:26.161258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:26.164873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:26.169763 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:26.171205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:26.172415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-28fc4d5a-dccd-4697-ac5d-fd17c80d17b9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.152834 Oct 10 17:13:26.172961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 275/535] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:26 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:27.199045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:27.199741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:27.206405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:27.206887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:27.207316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:27.208001 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:27.208477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:27.208900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:27.338983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:27.346893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:27.348363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:27.349513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d506acc2-1613-4b90-9902-5707dfbff1a1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.154760 Oct 10 17:13:27.350071 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 261/536] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:27 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:28.374647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:28.375331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:28.382672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:28.383142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:28.394765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:28.394765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:28.394765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:28.394765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:28.510333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:28.518287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:28.519745 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:28.520932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a942629d-3ca2-4b6d-83c6-f390126b1190 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.150208 Oct 10 17:13:28.521493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 276/537] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:28 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:29.547201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:29.547794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:29.554709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:29.555184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:29.555611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:29.556341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:29.556785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:29.557203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:29.685235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:29.693622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:29.695118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:29.696293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-37a53a8f-c4d6-4577-9525-ecd40156263b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.152926 Oct 10 17:13:29.696835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 262/538] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:29 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:30.721385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:30.721988 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:30.728393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:30.728869 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:30.729296 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:30.729971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:30.730445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:30.730862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:30.861821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:30.871217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:30.872704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:30.873859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6c8ec264-1b18-4688-bca9-a63d6c9ea46f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.156385 Oct 10 17:13:30.874402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 277/539] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:30 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:31.900522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:31.901124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:31.907449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:31.907927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:31.908382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:31.909062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:31.909505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:31.909921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:32.036611 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:32.044570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:32.046015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:32.047167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9aa2f213-3649-41f2-a2cb-8e5bdb256451 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.151009 Oct 10 17:13:32.047722 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 263/540] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:31 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:33.053513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:33.056843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:33.063530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.064011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.064465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.065235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.065732 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.067962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.073180 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:33.073800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:33.080293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.080783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.081471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.082395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.082919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.083541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.109622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f5a9845f-893e-4a97-93ac-134c05bb43a8 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060001 Oct 10 17:13:33.110787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 278/541] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:33 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:33.121918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:33.122401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:33.130026 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.130204 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.130495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.131192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:33.131644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:33.132144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:33.164653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-055157e3-8cb7-45b9-a5da-108889a1df54 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26" status: 200 len: 194 microversion: 2.1 time: 0.046700 Oct 10 17:13:33.165244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 279/542] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 10 17:13:33 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:33.222273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:33.230910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:33.232355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:33.233502 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c252b804-f0b0-498e-bb5a-0d7b009fbc6b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.164588 Oct 10 17:13:33.234099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 264/543] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:33 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:34.258750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:34.259345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:34.265645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:34.266125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:34.266559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:34.267240 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:34.267687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:34.268132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:34.395626 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:34.404146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:34.405560 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:34.406709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6f9e3eb4-dfb9-4f08-bb16-004a3e63b83b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.151963 Oct 10 17:13:34.407258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 280/544] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:34 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:34.810198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a853abd1-67b0-473e-ad4d-c8bd12de2060"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:34.812729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:34.819992 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:34.824421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:34.824421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:34.824421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:34.824421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:34.824779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:34.893786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:35.433132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:35.433731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:35.440046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:35.441810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:35.441810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:35.441810 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:35.442109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:35.442454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:35.496275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6393905d-a4dc-4d44-b599-0455341e12d7 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "POST /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689955 Oct 10 17:13:35.496947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 265/545] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:13:34 2022] POST /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:35.575619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:35.583859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:35.585436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:35.586591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-052824b5-f317-4b7c-9abb-c93c8e49deda tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1744 microversion: 2.20 time: 0.157930 Oct 10 17:13:35.587233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 281/546] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:35 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:36.482816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:36.488402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:36.490545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.491131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.491625 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:36.492460 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.492905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.493323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:36.523726 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:13:36.623056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:36.624653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:36.631764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.637233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.637233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:36.637233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.637233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.637573 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:36.778536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:36.789514 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:36.791046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:36.792376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6b497da6-281b-4bd9-9128-c778a7399065 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.173342 Oct 10 17:13:36.792989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 282/547] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:36 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:36.881058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6008be7b-25d0-4973-8984-a9d9a0855566 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 204 len: 0 microversion: 2.1 time: 0.401767 Oct 10 17:13:36.883536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 266/548] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:13:36 2022] DELETE /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:13:36.892495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:36.893352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:36.899958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.900483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.900928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:36.901813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:36.902271 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:36.902695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:37.036561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:37.045046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-34135fe8-66f0-4be7-85e1-079dd2036ee9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1579 microversion: 2.1 time: 0.157243 Oct 10 17:13:37.045623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 283/549] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:36 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:37.820287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:37.820978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:37.828677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:37.829833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:37.830292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:37.831164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:37.831791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:37.832229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:37.984603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:37.992854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:37.994313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:37.998706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-53690797-62eb-4678-9bf2-77e487d0e61e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.183608 Oct 10 17:13:37.999442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 267/550] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:37 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:38.069970 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:38.070668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:38.077365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:38.078517 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:38.079137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:38.080042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:38.080688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:38.081132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:38.267804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:38.276774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d62b7edc-1cdd-4c1f-b03f-e6dd21554b91 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1579 microversion: 2.1 time: 0.211851 Oct 10 17:13:38.281530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 284/551] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:38 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:38.820889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:38.832220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:38.832960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:38.833590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:38.845906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] Creating event network-vif-plugged:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:13:38.852230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-3a660065-8532-4c86-8ad7-44af2c22527a req-167569b3-677e-4cdc-9535-d23f5c211cde service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036040 Oct 10 17:13:38.853637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 268/552] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:39.026599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:39.027203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:39.042258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:39.043043 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:39.043474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:39.044208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:39.044814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:39.046835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:39.288490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:39.288490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:39.289155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:39.289155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8a58f834-8716-4ca1-b849-5cb49f81cf68 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.231697 Oct 10 17:13:39.289155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 285/553] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:39 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:39.302575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:39.303569 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:39.310868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:39.311643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:39.312257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:39.313253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:39.314242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:39.315953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:39.498401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:39.510080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5c5209a5-682a-424c-90f3-60099350d3ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1579 microversion: 2.1 time: 0.212440 Oct 10 17:13:39.524060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 269/554] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:39 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1579 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:40.153340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cead3c66-8618-4516-acda-9378f83705ce", "name": "network-vif-deleted", "tag": "7a29d464-4f74-45c8-b0f8-366ab7fa8148"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:40.164235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:40.164720 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:40.165156 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:40.178652 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] Creating event network-vif-deleted:7a29d464-4f74-45c8-b0f8-366ab7fa8148 for instance cead3c66-8618-4516-acda-9378f83705ce on hv-cinder-83454 Oct 10 17:13:40.185917 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-df6a52af-c16f-431f-b83b-dc02f6ad5a01 req-808e7dfc-ba16-4042-959a-fda788100a0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036338 Oct 10 17:13:40.186509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 286/555] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:40.281840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:40.283709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:40.289294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:40.289771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:40.290207 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:40.290895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:40.291362 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:40.291766 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:40.486024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:40.517092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:40.521077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:40.523353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d3df26b9-b82b-4bee-9381-218758bff2f8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.244765 Oct 10 17:13:40.524466 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 270/556] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:40 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:40.545065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:40.546525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:40.554022 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:40.554735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:40.555344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:40.556333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:40.556951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:40.557518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:40.637515 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:40.664599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4bad251b-d806-48d2-befe-1f3ac73b483e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1225 microversion: 2.1 time: 0.109960 Oct 10 17:13:40.664599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 287/557] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:40 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:41.549978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:41.551431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:41.565540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:41.566340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:41.567023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:41.567953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:41.573724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:41.573724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:41.685631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:41.687134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:41.697796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:41.698281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:41.698712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:41.699435 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:41.699879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:41.700323 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:41.713252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:41.722589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:41.724605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:41.726590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-58d63fb7-1ef4-4c58-a025-50bf15a4b375 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.180410 Oct 10 17:13:41.736504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 271/558] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:41 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:41.737514 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:41.738134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:41.738580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:41.739023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lazy-loading 'fault' on Instance uuid cead3c66-8618-4516-acda-9378f83705ce {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:41.784932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:41.790695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4b39570d-200e-4da0-ae3a-e6527b76f330 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 200 len: 1230 microversion: 2.1 time: 0.108822 Oct 10 17:13:41.791292 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 288/559] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:41 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:42.753370 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:42.753921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:42.761633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:42.762478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:42.763150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:42.764185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:42.765832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:42.766608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:42.822432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:42.823717 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:42.830785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:42.831656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:42.832124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:42.833004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:42.833663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:42.834280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:42.853183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] HTTP exception thrown: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Request method failure captured: Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce HTTP/1.1 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFH5uADiX5nDsoDfKzdmPVi77ARCYNb5tvC4h-JSTsa7t4HIGpfTr1KowbowTpflZ7tEGTBB-MG3H4g7FIMxydJppf-xYuGEQOs69WlUghAZ002-RLGxWgnCNqOBGlpT6kHmIkxcYuCBosag8R3yZYNFtmMAHPRec3UW5oaFnfxydIM Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:13:42.855525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0d86e93942189945656ccb70c059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0d86e93942189945656ccb70c059"}]}] Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-TestVolumeBootPattern-166268628 Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: d625c099d9134f78b3e8940879c19106 Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:13:42.856928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'cead3c66-8618-4516-acda-9378f83705ce'} Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:13:42.866129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:13:42.868017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:13:42.869723 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Returning 404 to user: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:13:42.869723 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f1279fe1-c194-4567-ad5d-89f8c4480a97 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 404 len: 111 microversion: 2.1 time: 0.039488 Oct 10 17:13:42.869723 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 289/560] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:42 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 17:13:42.946018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:42.954756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:42.956229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:42.957484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-030362be-b99f-4a9e-9854-550f98bfb607 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.208082 Oct 10 17:13:42.958058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 272/561] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:42 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:42.997687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1445553837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764167818", "security_groups": [{"name": "tempest-secgroup-smoke-1574135174"}], "block_device_mapping_v2": [{"uuid": "93e60741-653d-4adf-8565-66333d9b7e01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d40eb576-47ec-4491-b3a9-6394e24cb47e"}]}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:43.123131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] validate_networks() for [('d40eb576-47ec-4491-b3a9-6394e24cb47e', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:13:43.534272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:13:43.534782 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:13:43.535296 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:13:43.535728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:13:43.536176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:13:43.545528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:43.546066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:43.559797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:43.559797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:43.559797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:43.559797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:43.564415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:13:43.568432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for user d625c099d9134f78b3e8940879c19106 and project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:13:43.631146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:13:43.633346 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93e60741-653d-4adf-8565-66333d9b7e01',volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:13:43.957108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=62 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:43.982973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:43.983673 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:43.991688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:43.992292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:43.992812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:43.993573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:43.994094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:43.994757 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.117773 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f8f8c130-06cf-4f9d-98f8-38cef92c1364 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.123821 Oct 10 17:13:44.133689 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 290/562] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:13:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:13:44.152922 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-701fa9ec-92fe-4d31-878f-4c08e1b98b67 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:44.153552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-701fa9ec-92fe-4d31-878f-4c08e1b98b67 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:44.249446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-701fa9ec-92fe-4d31-878f-4c08e1b98b67 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:44.253629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:44.265506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:44.267074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-701fa9ec-92fe-4d31-878f-4c08e1b98b67 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1094 microversion: 2.1 time: 0.125629 Oct 10 17:13:44.268455 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 291/563] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:44 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:44.272100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:44.272100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-698a78ec-1a36-45cc-8e7b-f100345f483b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.292588 Oct 10 17:13:44.272868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 273/564] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:43 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:44.293066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:44.296118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:44.304313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.305247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.306018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.306891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.307797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.308573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.351736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-311cc2e9-cc8f-4883-9691-b2427e398f50 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069954 Oct 10 17:13:44.352357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 274/565] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:44 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:44.499794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:44.503137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:44.514949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.515451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.515887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.516805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.518349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.518781 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.567460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-45e61779-eada-4f5a-8793-7c6244f93a3c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26" status: 200 len: 194 microversion: 2.1 time: 0.071635 Oct 10 17:13:44.568129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 292/566] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 10 17:13:44 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:44.579043 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:44.579540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:44.585953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.586683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.587295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.588203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:44.588657 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:44.589263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:44.683238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lazy-loading 'services' on Instance uuid 59278b05-38e3-4729-aa7f-c7b3b9bd056d {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:44.932670 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-57412cfc-bad7-4afe-bcd6-c50f2a9f044b tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26" status: 202 len: 0 microversion: 2.1 time: 0.357381 Oct 10 17:13:44.933481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 275/567] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:13:44 2022] DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/e2e129f4-76bd-471b-a570-ed01d2203b26 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:13:45.306384 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:45.307640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:45.315661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:45.316655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:45.316805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:45.317381 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:45.317913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:45.319147 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:45.320214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:45.321001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:45.324921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:45.325603 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:45.328360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:45.329379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:45.330268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:45.330915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:45.401766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:45.410704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9e1537a8-0ee3-4c9a-9332-f60e209b0552 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1144 microversion: 2.1 time: 0.108289 Oct 10 17:13:45.425949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 293/568] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:45 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:45.506558 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:45.517916 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:45.519591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:45.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6c41f653-0c2f-4902-8129-9eaf361204ed tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.209480 Oct 10 17:13:45.536336 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 276/569] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:45 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:46.435925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:46.437326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:46.444095 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:46.445210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:46.445641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:46.446335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:46.446776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:46.447194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:46.518244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:46.526020 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cbe57270-b62e-4a86-ba97-97612f364562 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1192 microversion: 2.1 time: 0.094089 Oct 10 17:13:46.526566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 294/570] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:46 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:46.546858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:46.547550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:46.555515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:46.556005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:46.556467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:46.557175 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:46.557753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:46.558400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:46.690883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:46.699849 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:46.701327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:46.702509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7a778718-6631-4c50-b240-45b2f8d0decd tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.159649 Oct 10 17:13:46.703069 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 277/571] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:46 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:47.185138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:47.185620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:47.191406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.191882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.192342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.193019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.193465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.194144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.197880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:47.222767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bdf5c6cf-3aa7-434a-a2f6-e89d3721f8de tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/a853abd1-67b0-473e-ad4d-c8bd12de2060" status: 200 len: 194 microversion: 2.1 time: 0.041464 Oct 10 17:13:47.223260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 295/572] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 10 17:13:47 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/a853abd1-67b0-473e-ad4d-c8bd12de2060 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:47.234620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:47.235120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:47.241024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.241512 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.241949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.242639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.243095 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.243521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.320845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lazy-loading 'services' on Instance uuid 59278b05-38e3-4729-aa7f-c7b3b9bd056d {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:47.446085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:47.543635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6f21476a-9d27-46b8-be5e-45fe5ac9e8eb tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/a853abd1-67b0-473e-ad4d-c8bd12de2060" status: 202 len: 0 microversion: 2.1 time: 0.312598 Oct 10 17:13:47.544427 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 278/573] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:13:47 2022] DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments/a853abd1-67b0-473e-ad4d-c8bd12de2060 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:13:47.553106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:47.554541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:47.572504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.575277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.575828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.581828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.582445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.582983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.685049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:47.696195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-82d05293-dbd6-40c0-a8dd-4f54d9ecc84a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1200 microversion: 2.1 time: 0.146545 Oct 10 17:13:47.696195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 296/574] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:47 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1200 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:47.731344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:47.732816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:47.749011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.752342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.753094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.755528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:47.758132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:47.758886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:47.922419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:47.931405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:47.932933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:47.934263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bcf2b0bd-b3a7-40eb-8012-22a434693d7a tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.208937 Oct 10 17:13:47.940409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 279/575] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:47 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:48.718632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:48.719246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:48.725658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:48.726146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:48.726582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:48.727271 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:48.727727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:48.728193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:48.873229 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:48.882525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-61a70c91-0d54-41b1-9519-51c2ade31c63 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1278 microversion: 2.1 time: 0.166912 Oct 10 17:13:48.883433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 297/576] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:48 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:48.960967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:48.962169 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:48.969667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:48.970478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:48.970981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:48.971954 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:48.972616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:48.973429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:49.113368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:49.123816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:49.126249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:49.127324 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1558c913-5ebc-47af-843a-b698edd435db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1739 microversion: 2.20 time: 0.170885 Oct 10 17:13:49.140056 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 280/577] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:48 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:49.846929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:49.849401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:49.855858 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:49.856460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:49.856898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:49.862606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:49.862606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:49.862606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:49.888632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6dda78fe-b1f7-46ad-95cc-ce526e318e44 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046120 Oct 10 17:13:49.889195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 298/578] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:49 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:13:49.906613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:49.907221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:49.913389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:49.913876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:49.914399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:49.915104 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:49.915557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:49.915981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:49.998984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c61c0c-5d47-44dd-8cb0-12f76cd4a681", "tag": "33e35059-afb9-405e-9e7a-7271d3f1cfce"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:50.009040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.009522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.009955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.021398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] Creating event network-changed:33e35059-afb9-405e-9e7a-7271d3f1cfce for instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 on hv-cinder-83454 Oct 10 17:13:50.031002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-2357434d-1fce-4a1f-bdc1-2189af6b06a0 req-6fb80b4d-667a-4b95-956b-e06a22938985 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115325 Oct 10 17:13:50.031727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 299/579] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:13:50.037268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:50.039699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:50.045852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.046425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.046929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.047729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.048239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.048669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.074490 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:50.078326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bf8e4134-cc00-440a-a487-67595638e665 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045298 Oct 10 17:13:50.078896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 300/580] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:50 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:13:50.082972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-03e63284-03e8-421d-9f47-4b794f3da60c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1278 microversion: 2.1 time: 0.180282 Oct 10 17:13:50.083542 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 281/581] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:49 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:50.141194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:50.141685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:50.149219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.149694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.150134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.150830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.151279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.151695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.154569 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:50.155177 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:50.161117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.161593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.162020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.162740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.163218 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.163633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.176430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:13:50.291634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:50.299861 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:50.301545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:50.302705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b044fb75-bc07-4a0b-8278-d9fa32f0f73b tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1721 microversion: 2.20 time: 0.151933 Oct 10 17:13:50.303263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 282/582] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:50 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:50.421613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a09756c0-878e-43e3-8b71-3fe6a2a10ab3 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 204 len: 0 microversion: 2.1 time: 0.283998 Oct 10 17:13:50.422205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 301/583] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:13:50 2022] DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:13:50.430820 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:50.431430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:50.437428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.437908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.438341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.439030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:50.439479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:50.439900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:50.569979 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:50.577716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a376e751-2129-4a91-acda-9a8774e31460 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1673 microversion: 2.1 time: 0.151196 Oct 10 17:13:50.578272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 283/584] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:50 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:51.106656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:51.107356 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:51.113715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.114202 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.114640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.115374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.115784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.116792 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.244790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:51.252414 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bad2e0d0-783d-401a-8a73-0c5c1b09186d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1278 microversion: 2.1 time: 0.150023 Oct 10 17:13:51.252975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 302/585] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:51 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:51.329860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:51.330461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:51.336790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.337277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.337703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.338379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.338824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.339234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.467630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:51.476140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:51.478229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:51.478751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2d387e95-6bff-4876-b5ba-a093cfb19d12 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1721 microversion: 2.20 time: 0.152660 Oct 10 17:13:51.479301 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 284/586] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:51 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:51.602746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:51.603387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:51.609342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.609826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.610254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.610936 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:51.611379 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:51.611832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:51.737915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:51.745600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-544142bc-2967-42f5-916b-64afa3a84ff9 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1673 microversion: 2.1 time: 0.149068 Oct 10 17:13:51.746146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 303/587] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:51 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:52.275785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:52.276408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:52.282324 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.282802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.283226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.284068 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.284516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.284927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.410822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:52.418534 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-de2cb7e8-e56d-454f-8285-5ba266b0f044 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1278 microversion: 2.1 time: 0.147248 Oct 10 17:13:52.419087 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 285/588] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:52 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:52.504695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:52.505281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:52.512336 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.512815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.513242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.513915 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.514360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.514774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.642690 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:52.650671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:52.652125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:52.653272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-824d7386-a98d-4ae8-b146-4e95867ade79 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1721 microversion: 2.20 time: 0.152462 Oct 10 17:13:52.653825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 304/589] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:52 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:52.768838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:52.769438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:52.775359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.775835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.776300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.776978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.777426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.777845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.905805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:52.914001 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-31d88e95-c1d1-41ff-8b93-d030f81001cc tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1673 microversion: 2.1 time: 0.148477 Oct 10 17:13:52.914568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 286/590] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:52 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:52.959195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "name": "network-vif-unplugged", "status": "completed", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:52.968518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:52.969059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:52.969494 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:52.980605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] Creating event network-vif-unplugged:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:13:52.985809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-d1c5ff2d-8daa-4aeb-9857-aeaae617b43d req-c34741ec-1c24-4feb-ae95-2d4ac06333cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086777 Oct 10 17:13:52.986401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 305/591] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:13:53.441238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:53.441836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:53.448577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.449058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.449817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:53.450507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.450956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.451376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:53.584747 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:53.594763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c327a6f0-b9aa-4304-a47c-15b7c5661951 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1278 microversion: 2.1 time: 0.157311 Oct 10 17:13:53.595347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 287/592] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:53 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:53.676284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:53.680899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:53.681875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:53.688131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.688691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.689285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:53.690013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.690533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.691030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:53.818774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:53.828040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:53.829493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:53.830651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6a628536-bae9-45cb-ae74-f02506ea3776 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1721 microversion: 2.20 time: 0.155891 Oct 10 17:13:53.831202 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 306/593] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:53 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:13:53.937983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:53.938896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:53.941023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:53.946633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.947357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.947796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:53.948581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:53.952053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:53.952053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.139117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:54.147394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8c2a359e-1816-4427-84c8-25ddd14d40c6 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1673 microversion: 2.1 time: 0.213292 Oct 10 17:13:54.148009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 288/594] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:53 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:54.618434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:54.619053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:54.620970 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=8 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:54.626833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:54.627330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:54.627769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.628512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:54.628958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:54.639344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.790782 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59278b05-38e3-4729-aa7f-c7b3b9bd056d", "name": "network-vif-deleted", "tag": "05d674f5-f8de-4695-bd75-1646219b71d5"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:54.802802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:54.803752 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:54.804395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.817445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] Creating event network-vif-deleted:05d674f5-f8de-4695-bd75-1646219b71d5 for instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d on hv-cinder-83454 Oct 10 17:13:54.823479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-ffa5f723-abc0-4b08-92b8-6ed3925539ad req-c99e1608-df08-46ef-90ac-868c550d1b0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036738 Oct 10 17:13:54.834290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 289/595] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:13:54.859672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:54.860982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:54.867775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:54.868556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:54.869164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.870095 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:54.870706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:54.871287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:54.903237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:54.911250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8668868a-b9a0-4440-b694-a94c16787de8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.297470 Oct 10 17:13:54.916389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 307/596] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:54 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:55.045194 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:55.054214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:55.055732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:55.057010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f20344fb-bf10-49f6-a4f0-065b153b2d40 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1664 microversion: 2.20 time: 0.202928 Oct 10 17:13:55.057773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 290/597] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:54 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:55.083360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "357b6e38-df8a-4cff-80d3-93caa3e28e41"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:55.086603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:55.092552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.093065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.093497 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.094181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.094624 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.095041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.171011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:55.178146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:55.178992 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.179989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.180479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.181993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.182556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.182981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.217816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.218496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.218928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.219364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lazy-loading 'fault' on Instance uuid 59278b05-38e3-4729-aa7f-c7b3b9bd056d {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:55.259045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb27ad53d4a454eb10268ab27ad3258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aef1375628417b91f816bccd05d1cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:55.266642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c06397dc-4325-4c99-95af-dce696110354 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 200 len: 1327 microversion: 2.1 time: 0.099456 Oct 10 17:13:55.267201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 291/598] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:55 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:55.902212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:55.945927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:55.954049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:55.954049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.954049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.954049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.954743 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:55.955194 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:55.955615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:55.994079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b80a6cb4-bca1-4c17-aca2-214b6acd5139 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.915069 Oct 10 17:13:55.995012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 308/599] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Oct 10 17:13:55 2022] POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments => generated 188 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 17:13:56.086711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:56.094546 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-cf57a75f-f5dd-413c-b58c-350ef28b79fa tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.152752 Oct 10 17:13:56.095220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 292/600] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:55 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:56.125662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:56.126174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:56.132877 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.133358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.133792 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.134480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.134968 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.135391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.291276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:56.291883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:56.298326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.298836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.299301 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.299988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.300509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.300941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.314476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d HTTP/1.1 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:13:56.316146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:56.319383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '59278b05-38e3-4729-aa7f-c7b3b9bd056d'} Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:13:56.320261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:56.321900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:56.323118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:13:56.323118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a2ecbd24-db10-4330-9b57-decb257e0fee tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 404 len: 111 microversion: 2.1 time: 0.030760 Oct 10 17:13:56.323118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 293/601] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:56 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 17:13:56.326272 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7c0ef9d5-b440-44ce-9e8c-99a6c1039103 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '.version_select at 0x7f34ef350b80>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:56.430009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7c0ef9d5-b440-44ce-9e8c-99a6c1039103 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943984720" status: 202 len: 0 microversion: 2.1 time: 0.107187 Oct 10 17:13:56.430590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 294/602] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 10 17:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943984720 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:13:56.759623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-577cb471-331a-4302-90d7-7729f12645cc tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments/357b6e38-df8a-4cff-80d3-93caa3e28e41" status: 202 len: 0 microversion: 2.20 time: 0.637888 Oct 10 17:13:56.760248 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 309/603] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Oct 10 17:13:56 2022] DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments/357b6e38-df8a-4cff-80d3-93caa3e28e41 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:13:56.822749 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:13:56.823467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:56.829399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.829987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.830498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.831245 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:56.831798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:56.832327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:56.922019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119264) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 17:13:57.118566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:57.119162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:57.125345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.125831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.126258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.126942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.127377 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.127796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.213756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6243a86b-289e-401b-af80-94457f7b8bca tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/action" status: 202 len: 0 microversion: 2.20 time: 0.395712 Oct 10 17:13:57.215345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 295/604] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 10 17:13:56 2022] POST /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:13:57.223163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:57.223669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:57.230708 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.231167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.231777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.232451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.232906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.233327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.253045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:57.270109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:57.278264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6761b44c-8b94-443c-860f-b88c37e3287e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.164161 Oct 10 17:13:57.278840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 310/605] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:57 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:57.377578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:57.396332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:57.396332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:57.396332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-46dea8a0-b41e-4538-95d4-1f5328dbcb99 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1672 microversion: 2.20 time: 0.171033 Oct 10 17:13:57.396636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 296/606] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:57 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:57.791189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:57.791679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:57.798066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.798547 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.798981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.799662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:57.800144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:57.800568 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:57.882133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'services' on Instance uuid 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:13:58.112576 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1f79d14d-fd29-49a1-8fa6-d2996edee3c1 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments/9d25be1e-e22a-45e7-9a42-5d3e361ce132" status: 202 len: 0 microversion: 2.1 time: 0.325595 Oct 10 17:13:58.113101 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 311/607] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:13:57 2022] DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments/9d25be1e-e22a-45e7-9a42-5d3e361ce132 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:13:58.121454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:58.123627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:58.130853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.133748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.133748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.133748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.133748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.134102 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.164262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f0cea815-aba5-4b03-8fa7-82c18b808868 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046785 Oct 10 17:13:58.165134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 297/608] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:58 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:58.301600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:58.302345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:58.308678 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.309163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.309600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.310295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.310747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.311171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.415229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:58.416017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:58.427987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.427987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.427987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.427987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:58.428389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:58.428389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:58.447995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:58.456177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ae940e80-1913-4127-9e7e-6bb8766aef52 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.158661 Oct 10 17:13:58.456937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 312/609] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:58 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:13:58.562372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:58.571303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:58.572800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:58.573953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3d54701c-a8e6-4fd0-a555-bdbbded79c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1674 microversion: 2.20 time: 0.163231 Oct 10 17:13:58.574508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 298/610] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:58 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:13:59.177183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:59.179660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:59.186900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.187403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.188051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.188747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.189190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.189606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.220986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5dc4000f-836b-42cb-96b6-6fcc3decbe3a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047798 Oct 10 17:13:59.221595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 313/611] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:13:59 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:13:59.479412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:59.479942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:59.486329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.486809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.487243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.487927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.488494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.488917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.604589 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:59.605198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:59.611133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.611617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.612072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.612786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.613247 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.613798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.666879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:59.674959 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3a713c1b-d719-4c56-a827-ffdeb47c0507 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.200036 Oct 10 17:13:59.675823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 299/612] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:59 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:13:59.763543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:59.764078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:59.769963 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.770450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.771466 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.771581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.772419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.772559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.786530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d HTTP/1.1 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:13:59.788120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.793470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '59278b05-38e3-4729-aa7f-c7b3b9bd056d'} Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:13:59.794334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.795732 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.797273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:13:59.797273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bceef061-7fc5-4b35-acbc-917580b60a2c tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 404 len: 111 microversion: 2.1 time: 0.029834 Oct 10 17:13:59.797273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 300/613] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:13:59 2022] DELETE /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 17:13:59.801057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:13:59.801663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 59278b05-38e3-4729-aa7f-c7b3b9bd056d] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:13:59.807552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.808073 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.808522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.809220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:13:59.809674 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:13:59.810098 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:13:59.824524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d HTTP/1.1 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:13:59.826053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.827563 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '59278b05-38e3-4729-aa7f-c7b3b9bd056d'} Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:13:59.829042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. Oct 10 17:13:59.830451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:13:59.832184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 59278b05-38e3-4729-aa7f-c7b3b9bd056d could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:13:59.832184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-798397a4-353d-47bd-864b-ec6f3a4497ac tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d" status: 404 len: 111 microversion: 2.1 time: 0.033356 Oct 10 17:13:59.832184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 301/614] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:13:59 2022] GET /compute/v2.1/servers/59278b05-38e3-4729-aa7f-c7b3b9bd056d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 17:13:59.846115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:59.854724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:59.856192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:13:59.857403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e343c3ce-1826-4800-a4e0-958a74a8f4b8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.257034 Oct 10 17:13:59.857969 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 314/615] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:13:59 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 17:14:00.234185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:00.236445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:00.242487 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.243447 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.243889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.244601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.245055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.245475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.273883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1267dcbe-a178-43df-b09a-5f474be1f046 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043719 Oct 10 17:14:00.274432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 302/616] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:14:00 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:14:00.350685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:00.351191 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:00.358286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.358767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.359201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.359884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.360364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.360789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.386196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:14:00.668343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ddef6bc5-41ac-46d9-a5ac-d86cde290967 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 204 len: 0 microversion: 2.1 time: 0.321291 Oct 10 17:14:00.668996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 315/617] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:14:00 2022] DELETE /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:14:00.676813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:00.677423 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:00.683707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.684325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.684752 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.685443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.687170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.687170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.698247 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:00.699122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:00.706029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.706513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.706986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.707688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.710122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.710122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.895591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:00.900662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:00.903797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-30f326ee-985b-4274-9465-f5dfbbc77672 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.230777 Oct 10 17:14:00.904395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 303/618] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:00 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:00.908552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-26f6e8c6-13cf-4084-b791-f3e92cd1d09d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.214815 Oct 10 17:14:00.908853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:00.909245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 316/619] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:00 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:00.909919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:00.916345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.917041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.917502 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:00.918163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:00.918613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:00.919032 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.044047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:01.052140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:01.053850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:01.055003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-971b2f84-17cc-4232-994a-00b7d0cbe266 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.149699 Oct 10 17:14:01.055614 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 304/620] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:00 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:01.080149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:01.080643 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:01.087032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.087512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.087955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.088670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.089126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.089548 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.102466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e HTTP/1.1 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:14:01.104966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.109268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '83890954-0bab-4582-a1a0-46ba1a3d846e'} Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:14:01.110142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.111542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.113143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:14:01.113143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f4c909be-eec3-4831-8b15-e6f54dd85303 tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 404 len: 111 microversion: 2.1 time: 0.029195 Oct 10 17:14:01.113143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 317/621] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:14:01 2022] DELETE /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:14:01.115808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:01.116458 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] [instance: 83890954-0bab-4582-a1a0-46ba1a3d846e] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:01.122481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.122963 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.123423 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.124131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.124587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.125014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.138659 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] HTTP exception thrown: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Request method failure captured: Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e HTTP/1.1 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGC7GSAD73duMW8EOkcHWKxtrQ4aXs1d91Abv5LQSa6iB0asKM_rE1zEgT456sKZM_Hp50EMQ70CGpqrNpW8UH6F9onDdXCzWputt53fBIIzI1RRUMP6yHsS0kw4AS9-RliBBUh7GD-DsYGCzfLFh2nKtkG81bQTiKudiwuOjpwrk0 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:14:01.140199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18aef1375628417b91f816bccd05d1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18aef1375628417b91f816bccd05d1cf"}]}] Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 18aef1375628417b91f816bccd05d1cf Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeTestJSON-916247114 Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 8bb27ad53d4a454eb10268ab27ad3258 Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeTestJSON-916247114-project Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.141682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '83890954-0bab-4582-a1a0-46ba1a3d846e'} Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:14:01.142530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. Oct 10 17:14:01.144159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:01.145496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] Returning 404 to user: Instance 83890954-0bab-4582-a1a0-46ba1a3d846e could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:14:01.145496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9ad43ac2-c728-4cff-a91c-3cd1d181ce1a tempest-AttachVolumeTestJSON-916247114 tempest-AttachVolumeTestJSON-916247114-project] 10.222.0.42 "GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e" status: 404 len: 111 microversion: 2.1 time: 0.031522 Oct 10 17:14:01.145496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 305/622] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:01 2022] GET /compute/v2.1/servers/83890954-0bab-4582-a1a0-46ba1a3d846e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:14:01.926904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:01.927620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:01.932321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:01.932935 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:01.934933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.935431 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.935869 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.936892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.937107 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.937506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.939682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.940391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.940976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:01.941858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:01.942317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:01.942740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:02.138483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:02.142598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:02.146908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-322bcf48-ef8d-4803-95a4-5509faf26c22 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.223956 Oct 10 17:14:02.147472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 318/623] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:01 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:02.153159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:02.154002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:02.155038 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-494e8d01-0712-4ceb-a795-817efafe2df1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.227872 Oct 10 17:14:02.162703 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 306/624] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:01 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:02.168374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:02.169023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:02.169461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:02.170152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:02.170743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:02.171192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:02.302928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:02.311909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:02.313374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:02.314516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-603bcd9b-ae96-47e0-90a5-17d28feab44c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.165913 Oct 10 17:14:02.315072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 319/625] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:02 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:03.171420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:03.173538 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:03.178127 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:03.178978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.179541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.179677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:03.179910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.180636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.181088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.182012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.186373 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.186862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.187299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.188000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.188488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.188913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.479870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:03.485956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:03.491991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7d29e2f5-960c-4141-8307-7fd677f8a048 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.317258 Oct 10 17:14:03.496793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 320/626] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:03 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:03.501777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:03.502621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:03.502762 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-04f560ea-aaba-4f44-9f6f-9fa916ec79e5 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.333556 Oct 10 17:14:03.507262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 307/627] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:03 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:03.509610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.510345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.511010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.511916 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:03.512614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:03.513244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:03.530644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:03.730257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:03.738465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:03.739909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:03.741103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1952f379-96d5-4d49-b065-9bc91aa3b38e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.243123 Oct 10 17:14:03.742914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 321/628] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:03 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:04.517794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:04.519127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:04.526286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.527096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.527771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.528445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:04.529017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:04.529785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.530506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.531146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.542966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.543480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.547234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.547991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.548482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.548899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.842294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:04.853522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e108645b-dab1-466c-b3ee-70ec1c795ae0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.339436 Oct 10 17:14:04.854719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 308/629] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:04 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:04.866587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:04.873127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:04.879515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.880334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.880865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.881660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:04.882201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:04.882717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:04.911485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:04.921224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bc0516cc-bb50-4610-a71e-4103af47257b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.396184 Oct 10 17:14:04.924990 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 322/630] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:04 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:05.062733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:05.069841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c61c0c-5d47-44dd-8cb0-12f76cd4a681", "name": "network-vif-plugged", "status": "completed", "tag": "33e35059-afb9-405e-9e7a-7271d3f1cfce"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:05.085001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:05.085001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:05.085001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:05.085545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:05.085545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:05.085755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-86d9263f-9d88-4ccf-ad4c-81968040d9e9 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.229767 Oct 10 17:14:05.086431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 309/631] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:04 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:05.092703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] Creating event network-vif-plugged:33e35059-afb9-405e-9e7a-7271d3f1cfce for instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 on hv-cinder-83454 Oct 10 17:14:05.097872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-f334b066-9cc5-49fb-b8eb-748fafd46878 req-b1896ddb-128c-4887-a700-cb004bf8bb27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031989 Oct 10 17:14:05.098441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 323/632] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:14:05.876884 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:05.878543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:05.886387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:05.886953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:05.887587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:05.892166 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:05.892894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:05.893527 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:05.954678 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:05.955449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:05.963608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:05.964430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:05.965073 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:05.966086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:05.966766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:05.967390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:06.109914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:06.119074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0004e3ed-cc3c-4790-9826-81a43ccf4291 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.245818 Oct 10 17:14:06.132179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 310/633] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:05 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:06.143345 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:06.144486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:06.152373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:06.153174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:06.153609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:06.154313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:06.154791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:06.155215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:06.177698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:06.200930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-beee40cc-969e-445a-8ef7-785a9888bef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.255114 Oct 10 17:14:06.202989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 324/634] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:05 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:06.361062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:06.370195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:06.371693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:06.372910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f787e9da-dc95-4dc2-afb7-7d960c9843c8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.235217 Oct 10 17:14:06.373462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 311/635] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:06 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:07.144475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:07.145241 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:07.151995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.152661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.153200 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.154010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.154580 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.155239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.234003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:07.234622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:07.246488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.247141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.249289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.250217 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.250844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.251635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.641122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:07.664324 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-36c86979-6bd0-4a18-8fb6-60620155f8b1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.509386 Oct 10 17:14:07.664882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 325/636] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:07 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:07.672266 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:07.673216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:07.679461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.680310 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.680961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.687102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:07.687102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:07.687102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:07.722778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:07.734170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bc7f02dc-4f4a-46cd-ad16-b44850d880f8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.505722 Oct 10 17:14:07.735215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 312/637] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:07 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:07.852412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:07.860615 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:07.862424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:07.863787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6f9e4ae1-3022-4201-b5ac-af5446f8d866 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.197062 Oct 10 17:14:07.864843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 326/638] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:07 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:08.677753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:08.678375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:08.691459 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:08.691945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:08.692410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:08.693138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:08.693704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:08.694012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:08.758956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:08.760243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:08.771477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:08.772838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:08.778182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:08.779163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:08.779696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:08.780100 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:08.965583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:08.979419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-42fa9aad-cc1e-4163-a2e9-2e13d28b76ad tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.305699 Oct 10 17:14:08.983833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 313/639] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:08 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:08.992532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:08.993151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:09.007069 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:09.007618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:09.016363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:09.017289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:09.029442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:09.029442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:09.033944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:09.049268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-46181689-61ed-4a26-8a1a-75b4577d00fe tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.294334 Oct 10 17:14:09.068917 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 327/640] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:08 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:09.225179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:09.234350 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:09.235943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:09.237226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7f4357df-5da7-487a-8f1d-b1af31038961 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.252368 Oct 10 17:14:09.237988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 314/641] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:08 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:10.011133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:10.012347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:10.019339 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.019817 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.030729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.030729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.030729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.030729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.078948 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:10.079872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:10.091360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.092529 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.094305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.096608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.098117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.099432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.108675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:10.254109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:10.254109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7cda16ca-56ab-4b9b-847c-cef66b3725e0 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.242766 Oct 10 17:14:10.254109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 328/642] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:10 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:10.272604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:10.273547 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:10.282893 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.283777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.285094 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.286071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.286798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.287424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.304889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:10.319624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d63816ab-097b-4006-bd6b-c243f4b8e5bc tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.243993 Oct 10 17:14:10.345520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 315/643] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:10 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:10.446888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:10.456686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:10.459424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:10.459564 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4263a544-cb65-4bb5-a743-78cb57b6dd84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.197175 Oct 10 17:14:10.460196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 329/644] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:10 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:10.936929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "name": "network-vif-unplugged", "status": "completed", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:10.947015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:10.947491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:10.947919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:10.958843 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] Creating event network-vif-unplugged:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:14:10.965386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-71ba016c-03ff-4ae8-b9c2-9eedb74c6d09 req-2809301e-759e-4745-b2f6-430ceec6d9d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032033 Oct 10 17:14:10.965990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 316/645] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:11.279895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:11.282813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:11.299402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.303317 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.303865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.304781 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.305335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.308578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.354452 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:11.355847 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:11.362592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.363342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.363968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.364900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.365520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.366111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.656655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:11.656810 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:11.656929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5bfefdfd-6bc2-43af-a770-7277ed2c6b60 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.366253 Oct 10 17:14:11.656929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 330/646] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:11 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:11.657091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-61639aec-85e1-43c9-84f4-0eda73b14a9a tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.293184 Oct 10 17:14:11.657091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 317/647] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:11 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:11.657234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:11.657234 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:11.661436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.661941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.662386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.663102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:11.663553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:11.663977 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:11.842715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:11.854034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:11.855712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:11.857914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7d8ff288-614c-43ba-ba3e-cb2c41f3af7d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.217259 Oct 10 17:14:11.859454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 331/648] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:11 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:12.672569 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:12.674026 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:12.674553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:12.675406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:12.679066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:12.683778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.683901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.684308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:12.685005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.685453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.690499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:12.690738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.690738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.690949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:12.691566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.692045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.692477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:12.942388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:12.947491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:12.951697 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ef53e21f-35fb-4fcc-9d53-0253fc6d9ea2 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.284054 Oct 10 17:14:12.952575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 318/649] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:12 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:12.960498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:12.960498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:12.960736 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-edab8037-c702-4f51-83d1-8a114f8e1917 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.289829 Oct 10 17:14:12.970370 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.971120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.971865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:12.972943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 332/650] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:12 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:12.974190 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:12.974665 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:12.975099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:13.116826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:13.127188 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:13.128937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:13.130194 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f5ef3ee6-8178-4cae-ba52-6cfa491d3eb8 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.176593 Oct 10 17:14:13.130846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 319/651] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:12 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:13.982154 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:13.982885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:13.984045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:13.984665 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:13.989106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:13.989508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:13.989939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:13.990621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:13.991065 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:13.991185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:13.991482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:13.991581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:13.991974 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:13.992693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:13.993149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:13.993577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:14.297896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:14.305506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e0e0599d-9936-411a-b7d2-2cae7ed51745 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.327615 Oct 10 17:14:14.306074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 333/652] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:13 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:14.310123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:14.314345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:14.314952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:14.317753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fe248342-c48a-42a1-9e82-14830940c3d8 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1691 microversion: 2.1 time: 0.337797 Oct 10 17:14:14.318522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 320/653] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:13 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:14.323504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:14.324158 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:14.324892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:14.325564 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:14.326014 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:14.326438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:14.561378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:14.577250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:14.578489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:14.579718 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-307e6e20-0974-4dc6-a901-ea9a5f8a9028 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.269143 Oct 10 17:14:14.601007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 334/654] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:14 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:14.737539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1ca6a7-ee6c-4017-89c8-2a9cf2909847", "name": "network-vif-deleted", "tag": "a08541a8-03ca-473c-a3f6-55fbf4616d5d"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:14.746888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:14.747356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:14.747776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:14.758457 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] Creating event network-vif-deleted:a08541a8-03ca-473c-a3f6-55fbf4616d5d for instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 on hv-cinder-83454 Oct 10 17:14:14.763970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-509f7943-5ef9-4563-acf3-a6670270fb15 req-07a13109-c6db-455e-bfd1-04df2c04ca3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195112 Oct 10 17:14:14.764479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 321/655] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:15.328463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:15.329207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:15.335828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.336207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.336780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.337596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.338123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.338615 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.342792 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:15.343493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:15.351684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.352424 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.353685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.354585 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.355041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.355465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.391317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.391839 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.392304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.392937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'fault' on Instance uuid 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:14:15.457122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:15.466700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c3f48951-c92a-48a4-9294-5fbad74bd146 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1336 microversion: 2.1 time: 0.128535 Oct 10 17:14:15.476321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 322/656] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:15 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:15.565724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:15.574189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1abfd0f6-d4b4-438d-9f26-eb9bce0e6401 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1266 microversion: 2.1 time: 0.249471 Oct 10 17:14:15.574800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 335/657] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:15 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:15.607165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:15.607941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:15.614296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.617251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.617251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.617251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:15.617251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:15.617616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:15.760906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:15.769996 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:15.778226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:15.779617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7f227c24-5de8-4db2-ab39-2aace91a35e1 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.177198 Oct 10 17:14:15.780173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 323/658] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:15 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:16.490648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:16.491257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:16.498181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.498663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.499103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.499786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.500260 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.500739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.534011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.534488 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.535035 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.535353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'fault' on Instance uuid 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:14:16.576553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:16.584222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9c6cd8ef-2f84-4d66-8e88-4d31d99c936b tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 200 len: 1336 microversion: 2.1 time: 0.097459 Oct 10 17:14:16.584882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 336/659] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:16 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:16.598176 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:16.600116 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:16.606888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.607439 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.608239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.609143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.609571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.610275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.741936 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:16.750822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-66deb96d-a316-4539-8e98-ffed8e05003e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1453 microversion: 2.1 time: 0.156688 Oct 10 17:14:16.751621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 324/660] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:16 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:16.775840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:16.776560 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:16.782398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.782884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.783316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.784008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.784476 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.784951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.812965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:16.813818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:16.822188 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.822672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.823201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:16.823902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:16.824415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:16.824830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:17.049343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:17.054004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:17.059141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:17.060602 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:17.062024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-87d23e29-19ee-4de8-aadb-4a6608883c07 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.257710 Oct 10 17:14:17.062492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e88d674a-6baa-43ff-8283-60a71742add6 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1453 microversion: 2.1 time: 0.290808 Oct 10 17:14:17.062608 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 325/661] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:16 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:17.063768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 337/662] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:16 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1453 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:17.607941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:17.610127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:17.615670 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:17.616393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:17.616928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:17.617685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:17.618252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:17.618736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:17.633065 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] HTTP exception thrown: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Request method failure captured: Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 HTTP/1.1 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFHaP_lc3vz9pgrbr-DamSLD-d3HOHVBLpjHCiyCjIguhunDS3fnRBPsADHg6KlRNQOXvQRCHj6ci73jrmYEQ9WPQLGeXAnQLLDV9UO3HknmTjCRIuaWVawfLRIq8dELcjq3qPqgtBaHSMDnnk63gpwJ2swvH4Y_yR6n9Zu5w2comVQ Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:14:17.635248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2488f5601066432a8652433df5702119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2488f5601066432a8652433df5702119"}]}] Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 1e8d2e4a8a334eea973280b3819219e3 Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. Oct 10 17:14:17.636986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '4a1ca6a7-ee6c-4017-89c8-2a9cf2909847'} Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:14:17.637947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. Oct 10 17:14:17.639642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:17.641012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Returning 404 to user: Instance 4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:14:17.641012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6d737bb3-67b6-499b-bd45-c6165bec5f94 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847" status: 404 len: 111 microversion: 2.1 time: 0.033356 Oct 10 17:14:17.641012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 326/663] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:17 2022] GET /compute/v2.1/servers/4a1ca6a7-ee6c-4017-89c8-2a9cf2909847 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:14:17.645511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2cba6c99-0d1d-4c5e-b5fc-a6e80c750c06 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '.version_select at 0x7f34ef29f040>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:17.727462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2cba6c99-0d1d-4c5e-b5fc-a6e80c750c06 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760902907" status: 202 len: 0 microversion: 2.1 time: 0.085707 Oct 10 17:14:17.728232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 338/664] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 10 17:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760902907 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:14:18.087185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:18.087827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:18.093953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:18.094432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:18.094862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:18.095644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:18.096119 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:18.096544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:18.320837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:18.336183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:18.339025 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:18.342756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-646ecfbd-eb7c-4470-9eef-9780131c2b65 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.258440 Oct 10 17:14:18.356246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 327/665] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:18 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:19.075239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:19.097156 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:19.097908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:19.098553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:19.110531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] Creating event network-vif-plugged:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:14:19.116223 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-3c5b4c22-35ee-4a1d-820f-923ee98500c1 req-4f5e61b8-7abf-4d0d-9353-5781ae9218da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045888 Oct 10 17:14:19.117113 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 339/666] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:19.372330 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:19.373675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:19.388197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:19.388782 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:19.389238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:19.389973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:19.390429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:19.390853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:19.526091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:19.534591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:19.536192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:19.537364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7477aa2e-d262-4c5f-a8e8-bbcb3e1e949c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.170519 Oct 10 17:14:19.555031 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 328/667] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:19 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:19.794126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c61c0c-5d47-44dd-8cb0-12f76cd4a681", "tag": "33e35059-afb9-405e-9e7a-7271d3f1cfce"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:19.799594 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:19.800104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:19.800534 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:19.804737 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:19.812876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] Creating event network-changed:33e35059-afb9-405e-9e7a-7271d3f1cfce for instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 on hv-cinder-83454 Oct 10 17:14:19.817860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-a9633c5a-bd66-4364-adad-cedeb74c2f6e req-8edc08be-55ef-47ec-b876-e56ef15ad680 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Oct 10 17:14:19.818668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 340/668] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:20.564382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:20.565588 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:20.573880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:20.574646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:20.575238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:20.576123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:20.576719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:20.581206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:20.738284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:20.748406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:20.750143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:20.751763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-10e542b2-8fce-40c8-8c6c-44820f07f02f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.191379 Oct 10 17:14:20.752488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 329/669] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:20 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:21.203536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:21.204138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:21.210823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.211359 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.211798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.212532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.212987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.213401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.238837 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:14:21.537483 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fc26d960-6066-498c-b8c0-553359576d87 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 204 len: 0 microversion: 2.1 time: 0.338600 Oct 10 17:14:21.539604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 341/670] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:14:21 2022] DELETE /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:14:21.547133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:21.547748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:21.554035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.554587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.555220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.555969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.557022 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.557503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.688079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:21.696252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f426bf43-d529-4b4b-8493-d7b94cdcf27c tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1507 microversion: 2.1 time: 0.153235 Oct 10 17:14:21.696816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 330/671] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:21 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:14:21.782870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:21.783563 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:21.789439 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.789921 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.790353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.791776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:21.792321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:21.793151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:21.931290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:21.939958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:21.941802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:21.943177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-95c52dfb-4691-4df5-a4ce-6a0cf3eaca84 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.164783 Oct 10 17:14:21.943819 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 342/672] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:21 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:22.719390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:22.719908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:22.726302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:22.726779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:22.727205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:22.727883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:22.728915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:22.729333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:22.855540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:22.863213 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-efd20929-f92e-43bd-b389-554b16f54c97 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1507 microversion: 2.1 time: 0.147762 Oct 10 17:14:22.863775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 331/673] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:22 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:22.975110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:22.975673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:22.982541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:22.983015 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:22.983445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:22.984148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:22.984596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:22.985014 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:23.111462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:23.119460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:23.120942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:23.122231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-76832d51-a5b6-4c91-a6ac-1e3dbf48e3f7 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1730 microversion: 2.20 time: 0.151098 Oct 10 17:14:23.122780 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 343/674] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:22 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:23.886353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:23.886953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:23.890444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:23.893805 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:23.894279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:23.894712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:23.895388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:23.895831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:23.896270 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:24.033921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:24.041628 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4bcfecbe-d4a8-4772-9bbd-882c7ba70ef2 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1507 microversion: 2.1 time: 0.159610 Oct 10 17:14:24.042197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 332/675] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:23 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:24.150999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:24.150999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:24.156302 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:24.156708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:24.157143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:24.157830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:24.158279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:24.158695 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:24.292816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:24.303061 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:24.305638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:24.307778 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fa92bc08-3c04-4292-bf85-9c2c61b2c7e3 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1717 microversion: 2.20 time: 0.162905 Oct 10 17:14:24.308174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 344/676] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:24 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:24.757912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9c95be-f85e-4793-8479-b522932cab7c", "name": "network-vif-deleted", "tag": "479a06ae-07fd-4ef7-a1fe-f3e76ecf1536"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:24.767405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:24.768670 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:24.768779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:24.782666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] Creating event network-vif-deleted:479a06ae-07fd-4ef7-a1fe-f3e76ecf1536 for instance 1d9c95be-f85e-4793-8479-b522932cab7c on hv-cinder-83454 Oct 10 17:14:24.787997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-72ac9252-98ca-49b1-8d0d-58ee9b5bce48 req-3c27d763-d63a-4d16-b54f-7d907a1094f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Oct 10 17:14:24.788592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 333/677] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:25.065728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:25.066333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:25.073140 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:25.073826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:25.078709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:25.078709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:25.078709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:25.078709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:25.145290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:25.154205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-add48128-71af-4564-b75f-df3ea0e18473 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 200 len: 1292 microversion: 2.1 time: 0.092382 Oct 10 17:14:25.154945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 345/678] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:25 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:26.177231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:26.177930 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: 1d9c95be-f85e-4793-8479-b522932cab7c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:26.184309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.184606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.185045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.185740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.186192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.186618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.190818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:26.201666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] HTTP exception thrown: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Request method failure captured: Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c HTTP/1.1 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFHaP_lc3vz9pgrbr-DamSLD-d3HOHVBLpjHCiyCjIguhunDS3fnRBPsADHg6KlRNQOXvQRCHj6ci73jrmYEQ9WPQLGeXAnQLLDV9UO3HknmTjCRIuaWVawfLRIq8dELcjq3qPqgtBaHSMDnnk63gpwJ2swvH4Y_yR6n9Zu5w2comVQ Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:14:26.201912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2488f5601066432a8652433df5702119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2488f5601066432a8652433df5702119"}]}] Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 1e8d2e4a8a334eea973280b3819219e3 Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. Oct 10 17:14:26.203479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '1d9c95be-f85e-4793-8479-b522932cab7c'} Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:14:26.204384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. Oct 10 17:14:26.205895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:26.207676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Returning 404 to user: Instance 1d9c95be-f85e-4793-8479-b522932cab7c could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:14:26.207676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fbb2c377-5970-430c-8a6b-959196df651f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c" status: 404 len: 111 microversion: 2.1 time: 0.030788 Oct 10 17:14:26.207676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 334/679] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:26 2022] GET /compute/v2.1/servers/1d9c95be-f85e-4793-8479-b522932cab7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:14:26.213434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:26.213934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:26.220589 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.221081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.221545 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.222273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.222683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.224687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.249759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:14:26.530996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d0becddf-6d03-44b2-b598-9cc11fb56ccb tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 204 len: 0 microversion: 2.1 time: 0.322170 Oct 10 17:14:26.531592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 346/680] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:14:26 2022] DELETE /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:14:26.539954 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:26.540649 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:26.546682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.547167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.547612 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.548340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:26.548799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:26.549226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:26.682947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:26.690931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-56f61b87-0064-4ffd-8d4f-2251e46d4f59 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.155196 Oct 10 17:14:26.691490 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 335/681] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:26 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:27.715663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:27.716375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:27.722673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:27.723151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:27.723579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:27.724311 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:27.724800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:27.725222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:27.856265 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:27.864149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7a2813c7-1609-4c8a-ad52-7a95fd50247f tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.153052 Oct 10 17:14:27.864715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 347/682] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:27 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:28.886648 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:28.887291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:28.894297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:28.894790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:28.895202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:28.895911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:28.896402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:28.896830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:29.033383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:29.041142 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e334feda-4133-4c1e-97b3-b5f90a9c1ef7 tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.158320 Oct 10 17:14:29.042247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 336/683] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:28 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:30.065569 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:30.066188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:30.073502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:30.073984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:30.074420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:30.075105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:30.075556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:30.075976 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:30.208461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:30.225750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6997b172-3d64-415a-95c3-f5a30f80951e tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1522 microversion: 2.1 time: 0.154495 Oct 10 17:14:30.225750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 348/684] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:30 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:30.647962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69da494-0060-4875-9dc0-625701fa03b5", "name": "network-vif-deleted", "tag": "37d21674-f89a-4d01-9819-f5ad96f87075"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:14:30.658895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:30.659424 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:30.659852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:30.671231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] Creating event network-vif-deleted:37d21674-f89a-4d01-9819-f5ad96f87075 for instance e69da494-0060-4875-9dc0-625701fa03b5 on hv-cinder-83454 Oct 10 17:14:30.676319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-cf6c59f9-4a4d-4bfd-a7d5-da10e49489cc req-abddbdd2-6acd-440f-9831-285de026619f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Oct 10 17:14:30.676956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 337/685] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:14:31.239517 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:31.240151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:31.246410 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:31.246884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:31.247316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:31.247992 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:31.248473 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:31.248888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:31.279734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:31.280231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:31.280657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:31.281091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lazy-loading 'fault' on Instance uuid e69da494-0060-4875-9dc0-625701fa03b5 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:14:31.324655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8d2e4a8a334eea973280b3819219e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2488f5601066432a8652433df5702119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:31.332207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f57d9e96-05fd-4435-9b03-6670d8b537ee tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 200 len: 1311 microversion: 2.1 time: 0.096623 Oct 10 17:14:31.332760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 349/686] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:31 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:32.356132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:32.356831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] [instance: e69da494-0060-4875-9dc0-625701fa03b5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:32.363376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:32.363856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:32.364316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:32.364995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:32.365446 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:32.365865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:32.378675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] HTTP exception thrown: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Request method failure captured: Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 HTTP/1.1 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFHaP_lc3vz9pgrbr-DamSLD-d3HOHVBLpjHCiyCjIguhunDS3fnRBPsADHg6KlRNQOXvQRCHj6ci73jrmYEQ9WPQLGeXAnQLLDV9UO3HknmTjCRIuaWVawfLRIq8dELcjq3qPqgtBaHSMDnnk63gpwJ2swvH4Y_yR6n9Zu5w2comVQ Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:14:32.380279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2488f5601066432a8652433df5702119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2488f5601066432a8652433df5702119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2488f5601066432a8652433df5702119"}]}] Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 2488f5601066432a8652433df5702119 Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961496622 Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 1e8d2e4a8a334eea973280b3819219e3 Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961496622-project Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. Oct 10 17:14:32.381721 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'e69da494-0060-4875-9dc0-625701fa03b5'} Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:14:32.382469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. Oct 10 17:14:32.383860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:14:32.385536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] Returning 404 to user: Instance e69da494-0060-4875-9dc0-625701fa03b5 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:14:32.385536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-774565c2-6c54-479e-955e-3bc840f513cf tempest-ServerRescueNegativeTestJSON-961496622 tempest-ServerRescueNegativeTestJSON-961496622-project] 10.222.0.42 "GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5" status: 404 len: 111 microversion: 2.1 time: 0.030413 Oct 10 17:14:32.385536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 338/687] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:14:32 2022] GET /compute/v2.1/servers/e69da494-0060-4875-9dc0-625701fa03b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:14:57.155639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:57.158526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:57.160716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:57.161383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:57.166809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.167578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.168281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.170758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.171438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.172562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.213853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2e9652ff-17c1-4036-bc82-aca7ae0455fe tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062579 Oct 10 17:14:57.214734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 350/688] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 10 17:14:57 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:14:57.290967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:57.291528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:57.293995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=12 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:57.295198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=16 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:14:57.300046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.300553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.301019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.301714 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.302184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.302609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.331873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:14:57.651167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-db08faad-4cd4-4be0-b069-07be5ab5d18c tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 204 len: 0 microversion: 2.20 time: 0.363851 Oct 10 17:14:57.651754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 339/689] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 10 17:14:57 2022] DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 17:14:57.663825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:57.664501 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:57.679213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.680215 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.680656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.681360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:57.681812 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:57.682239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:57.915172 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:57.924814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:57.926258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:57.927440 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a8f16052-3027-4e47-9550-33cfcba88519 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.270509 Oct 10 17:14:57.928003 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 351/690] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:57 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:14:58.961424 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:14:58.962122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:14:58.975589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:58.978548 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:58.979005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:58.981092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:14:58.982598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:14:58.983046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:14:59.137616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:59.148533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:59.150138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:14:59.151477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-48fe23d3-402f-4848-a57c-c4aed4359393 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.197981 Oct 10 17:14:59.152108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 340/691] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:14:58 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:15:00.180440 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:00.182331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:00.191221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:00.192004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:00.192756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:00.193794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:00.194589 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:00.195138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:00.411292 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:00.427731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:00.429203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:00.430380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-029ef792-8d33-44e6-848e-740853c9481f tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1723 microversion: 2.20 time: 0.256398 Oct 10 17:15:00.430940 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 352/692] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:15:00 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:15:00.716723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fbb112-41b5-47f4-9c56-50fbd9bce1ef", "name": "network-vif-deleted", "tag": "f938a200-0c9b-43cd-8513-d12ee6b10a6e"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:00.726895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:00.729684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:00.729684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:00.739518 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] Creating event network-vif-deleted:f938a200-0c9b-43cd-8513-d12ee6b10a6e for instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef on hv-cinder-83454 Oct 10 17:15:00.746091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-0c28ee9c-5869-4a75-b0e0-b0dfb2644523 req-82885a60-b3c4-4147-9536-a144724b621e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Oct 10 17:15:00.758006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 341/693] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:01.458843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:01.459399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:01.472527 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:01.473255 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:01.473742 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:01.474591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:01.475043 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:01.475525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:01.547238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:01.547956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:01.548421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:01.549171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lazy-loading 'fault' on Instance uuid e7fbb112-41b5-47f4-9c56-50fbd9bce1ef {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:15:01.633221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:01.649437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:01.649437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8507de448b6455fb792bda0c949421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f584f725354f68b917b45b645b3630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:01.651156 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b88dc386-c589-47ab-93c6-db8837bd2917 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 200 len: 1371 microversion: 2.20 time: 0.196440 Oct 10 17:15:01.653524 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 353/694] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:15:01 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 17:15:02.688984 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:02.690471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:02.706575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:02.711329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:02.711779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:02.712595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:02.713283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:02.713719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:02.739651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef HTTP/1.1 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:15:02.741469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:02.742968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'e7fbb112-41b5-47f4-9c56-50fbd9bce1ef'} Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:15:02.743756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:02.745705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:02.747576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:15:02.747576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d606e088-027e-4c06-a7b7-77c8fb7a2320 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 404 len: 111 microversion: 2.20 time: 0.061998 Oct 10 17:15:02.747576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 342/695] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:15:02 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:15:02.753642 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-38206f03-3d25-497e-9ad9-47abbdcd0259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '.version_select at 0x7f34ef29f700>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:02.818171 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-38206f03-3d25-497e-9ad9-47abbdcd0259 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603877069" status: 204 len: 0 microversion: 2.20 time: 0.069179 Oct 10 17:15:02.818966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 354/696] 10.222.0.42 () {60 vars in 1262 bytes} [Mon Oct 10 17:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603877069 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 17:15:05.385092 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:05.385726 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:05.393035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:05.393751 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:05.394368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:05.395233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:05.395896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:05.396683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:05.413597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef HTTP/1.1 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:15:05.416315 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.417723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'e7fbb112-41b5-47f4-9c56-50fbd9bce1ef'} Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:15:05.418477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.420913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.423410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:15:05.423410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4018dc5e-8a02-4e4c-80a8-f7ef5371bf16 tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 404 len: 111 microversion: 2.20 time: 0.037072 Oct 10 17:15:05.423410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 343/697] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 10 17:15:05 2022] DELETE /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 17:15:05.428919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:05.429537 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: e7fbb112-41b5-47f4-9c56-50fbd9bce1ef] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:05.442880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:05.443308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:05.443744 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:05.444498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:05.444952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:05.445372 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:05.462848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef HTTP/1.1 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:15:05.464638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.466131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'e7fbb112-41b5-47f4-9c56-50fbd9bce1ef'} Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:15:05.467102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. Oct 10 17:15:05.468640 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:05.470567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance e7fbb112-41b5-47f4-9c56-50fbd9bce1ef could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:15:05.470567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7426a55b-b5d0-4aca-b0ef-60693bbc4f9d tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef" status: 404 len: 111 microversion: 2.20 time: 0.041182 Oct 10 17:15:05.470567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 355/698] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:15:05 2022] GET /compute/v2.1/servers/e7fbb112-41b5-47f4-9c56-50fbd9bce1ef => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:15:06.779706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:06.780487 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:06.786900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:06.787437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:06.787924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:06.788776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:06.789226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:06.793214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:06.803918 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 HTTP/1.1 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:15:06.805654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.807253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '65073136-459b-4282-b371-c7bf0f7144d2'} Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:15:06.808163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.809565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.811515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:15:06.811515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-303ed8ff-f940-417c-b76e-93971c6ce7db tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 404 len: 111 microversion: 2.20 time: 0.031827 Oct 10 17:15:06.811515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 344/699] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 10 17:15:06 2022] DELETE /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:15:06.817814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:06.818562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] [instance: 65073136-459b-4282-b371-c7bf0f7144d2] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:06.825635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:06.826511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:06.826950 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:06.827796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:06.828324 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:06.828683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:06.846536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] HTTP exception thrown: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Request method failure captured: Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 HTTP/1.1 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFGAPHfCgcttbXBaRYjT2XPFddlEQA4tXPPmKFwAA8V63YwzpGaBT7CudvgRAeUF79vwVu7M2m_k_vQioPJdPsNn_O5j9l057zi7qMOKy25K2yAjmXFZuAnBfV2tMfpk_reyrYaB6tH3S8MPp5-QYnby2Y_n5tkQPAHGwyjW2kVZYZs Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:15:06.848290 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34f584f725354f68b917b45b645b3630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34f584f725354f68b917b45b645b3630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34f584f725354f68b917b45b645b3630"}]}] Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 34f584f725354f68b917b45b645b3630 Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1290963556 Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: b8507de448b6455fb792bda0c949421d Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1290963556-project Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.849942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '65073136-459b-4282-b371-c7bf0f7144d2'} Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:15:06.850900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. Oct 10 17:15:06.853108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:15:06.856089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] Returning 404 to user: Instance 65073136-459b-4282-b371-c7bf0f7144d2 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:15:06.857885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5ce61667-00ce-4dfd-80ec-5ffdf576e70e tempest-AttachVolumeShelveTestJSON-1290963556 tempest-AttachVolumeShelveTestJSON-1290963556-project] 10.222.0.42 "GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2" status: 404 len: 111 microversion: 2.20 time: 0.045601 Oct 10 17:15:06.858883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 356/700] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 10 17:15:06 2022] GET /compute/v2.1/servers/65073136-459b-4282-b371-c7bf0f7144d2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 17:15:20.488874 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-53016705-6821-4469-ac6f-4b6d8ee24f01 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'create', calling method: .version_select at 0x7f34ef2d03a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1522106937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv+NhTdrXBQ+lBSLFTwBBiJlpLH78vvDn/b2njTaL4BUVwYT+Qg9RY00r4IDnvq1HJt+skEB5EaVMJApMtR5QWQFtJwfb9nXBr8j540TnDJzgBwJOC3/Duvy0qHcs72zA=="}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:20.496173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:20.497027 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:20.510178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-53016705-6821-4469-ac6f-4b6d8ee24f01 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Getting quotas for project 4f9731af8c4c4188bc61c7f35b8bdc5e. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:15:20.531968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-53016705-6821-4469-ac6f-4b6d8ee24f01 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Getting quotas for user e750af16ce0d4742a3305141470ff308 and project 4f9731af8c4c4188bc61c7f35b8bdc5e. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:15:20.692516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-53016705-6821-4469-ac6f-4b6d8ee24f01 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.207538 Oct 10 17:15:20.694234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 345/701] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:15:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:20.796163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1425096769", "imageRef": "df76b852-1b79-4fe1-91bc-007e973161aa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1522106937", "networks": [{"uuid": "a15f2f44-a2b5-453b-9078-70aae54a8d77"}]}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:20.819001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:20.819890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=30 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:20.879641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] validate_networks() for [('a15f2f44-a2b5-453b-9078-70aae54a8d77', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:15:21.502533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:15:21.503039 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:15:21.503558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:15:21.504455 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:15:21.505059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:15:21.516413 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:21.516895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:21.517570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:21.518552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:21.519348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:21.519993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:21.541707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Getting quotas for project 4f9731af8c4c4188bc61c7f35b8bdc5e. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:15:21.545864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Getting quotas for user e750af16ce0d4742a3305141470ff308 and project 4f9731af8c4c4188bc61c7f35b8bdc5e. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:15:21.564019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:15:21.564019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df76b852-1b79-4fe1-91bc-007e973161aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:15:21.708072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-62aa0afd-e8ed-40c5-a8eb-17171f97fd63 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916250 Oct 10 17:15:21.709310 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 357/702] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:15:21.720426 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-95834cfd-cef4-45ee-9a15-ae1f6fe60500 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:21.721768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-95834cfd-cef4-45ee-9a15-ae1f6fe60500 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:21.805951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-95834cfd-cef4-45ee-9a15-ae1f6fe60500 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:21.815168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-95834cfd-cef4-45ee-9a15-ae1f6fe60500 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1259 microversion: 2.1 time: 0.098394 Oct 10 17:15:21.816384 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 346/703] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:21 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1259 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:22.288708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-61581f6b-1e2d-4138-85fe-1d553d979d24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: .version_select at 0x7f34ef253280>, body: {"keypair": {"name": "tempest-keypair-1115731019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPetXVJfnX5lWtmFV2VlNkf7C2z98vW65a0nHYzeMTDWgRyoBnOvNxNFLE2aokmBrNEcsARYEyZO7+hSnjW34HZv9LCxmMHTYPVZUq4FKDPpFCQ31p2Qt7BSxwVyRbO8mw=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:22.306478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-61581f6b-1e2d-4138-85fe-1d553d979d24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:15:22.312533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-61581f6b-1e2d-4138-85fe-1d553d979d24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:15:22.407498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-61581f6b-1e2d-4138-85fe-1d553d979d24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.253906 Oct 10 17:15:22.408140 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 358/704] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:15:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:22.841342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c6fda7bd-052f-47ee-8e8b-c5f7b017f908 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:22.842328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c6fda7bd-052f-47ee-8e8b-c5f7b017f908 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:22.906772 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c6fda7bd-052f-47ee-8e8b-c5f7b017f908 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:22.914218 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c6fda7bd-052f-47ee-8e8b-c5f7b017f908 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1259 microversion: 2.1 time: 0.076753 Oct 10 17:15:22.914789 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 347/705] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:22 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:23.941261 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:23.941864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:23.948154 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:23.948641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:23.949079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:23.949820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:23.950272 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:23.951335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:24.035289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:24.043351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a070ea0c-6017-432e-a8a1-c671f0a7dd3b tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1255 microversion: 2.1 time: 0.106674 Oct 10 17:15:24.044536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 359/706] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:23 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1255 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:24.607440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-354498125", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "networks": [{"uuid": "e8f36e2a-b122-4a19-98f7-7d10c957a7f1"}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:24.676960 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] validate_networks() for [('e8f36e2a-b122-4a19-98f7-7d10c957a7f1', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:15:25.066884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:25.067496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:25.074074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:25.074774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:25.075981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:25.076891 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:25.077500 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:25.078079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:25.110597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:15:25.111075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:15:25.111547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:15:25.112013 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:15:25.112635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:15:25.127727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:25.127727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:25.127727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:25.127727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:25.128199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:25.128199 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:25.158910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:25.162094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Getting quotas for project b9422ce68e164e7d8ae8dbf168e58e78. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:15:25.166294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Getting quotas for user a800d4a53c234d2fa53eeb0c68163f44 and project b9422ce68e164e7d8ae8dbf168e58e78. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:15:25.167346 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-32209c92-ca52-4e58-ba72-2a62040ceac2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1329 microversion: 2.1 time: 0.104378 Oct 10 17:15:25.169829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 360/707] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:25 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:25.181551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:15:25.183865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:15:25.329575 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1419468243", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0"}], "security_groups": [{"name": "tempest-securitygroup--1363219736"}], "key_name": "tempest-keypair-1115731019", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:25.336687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ca6487cd-b231-4140-af8f-872a80b93bfd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735738 Oct 10 17:15:25.338047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 348/708] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:15:25.349450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ba4a9c4b-cfdc-4b5f-83d3-8aeb72c20187 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:25.350684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ba4a9c4b-cfdc-4b5f-83d3-8aeb72c20187 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:25.465901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ba4a9c4b-cfdc-4b5f-83d3-8aeb72c20187 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:25.474618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ba4a9c4b-cfdc-4b5f-83d3-8aeb72c20187 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1218 microversion: 2.1 time: 0.128468 Oct 10 17:15:25.499756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 349/709] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:25 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:25.532767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] validate_networks() for [('87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:15:26.036501 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:15:26.037062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:15:26.037543 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:15:26.037986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:15:26.038389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:15:26.053877 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:26.058656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:26.058656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:26.058656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:26.058656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:26.071658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:26.130637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:15:26.153625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:15:26.197461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:26.199592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:26.213609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:26.214730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:26.216700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:26.220289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:26.222409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:26.223988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:26.230109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:15:26.235806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:15:26.473364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:26.483234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5ecaca5b-3b43-4064-9c38-7d3069115a15 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.292274 Oct 10 17:15:26.484387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 350/710] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:26 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:26.509344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e0fabc86-43bf-4b73-8a55-eecc5aef7c89 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:26.510360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e0fabc86-43bf-4b73-8a55-eecc5aef7c89 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:26.520390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-741d4723-9219-42c7-8efd-a19096ea7755 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.202346 Oct 10 17:15:26.521178 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 361/711] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:15:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 17:15:26.538009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-33fe6241-0d61-470b-a67f-1721c8c53c36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:26.538710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-33fe6241-0d61-470b-a67f-1721c8c53c36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:26.629012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e0fabc86-43bf-4b73-8a55-eecc5aef7c89 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:26.638120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e0fabc86-43bf-4b73-8a55-eecc5aef7c89 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1218 microversion: 2.1 time: 0.135000 Oct 10 17:15:26.660946 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 351/712] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:26 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:26.720589 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-33fe6241-0d61-470b-a67f-1721c8c53c36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:26.730129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-33fe6241-0d61-470b-a67f-1721c8c53c36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1242 microversion: 2.1 time: 0.198338 Oct 10 17:15:26.732453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 362/713] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:26 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:27.508134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:27.517427 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:27.519962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:27.530022 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:27.532101 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:27.532101 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:27.532778 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:27.533441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:27.534087 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:27.534866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:27.535348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:27.535784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:27.547793 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] Creating event network-changed:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:15:27.563257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-201a9ece-ec6c-4f94-94f2-eb76c5c0f8e3 req-09d1125e-0546-4cf8-a624-58eb328a84bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057724 Oct 10 17:15:27.568163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 352/714] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:27.662195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:27.664061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:27.670579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:27.671160 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:27.671727 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:27.672810 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:27.673303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:27.673824 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:27.743696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:27.757756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-918dd544-c12f-4f2d-a6b9-808c896d915f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.246739 Oct 10 17:15:27.758776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 363/715] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:27 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:27.762471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:27.767193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3ae2a6f9-e1df-48ba-a5bc-ab983ce32c1a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:27.767193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3ae2a6f9-e1df-48ba-a5bc-ab983ce32c1a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:27.772427 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6ee8bbf7-b264-43fc-b036-f8924abf76fb tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.114573 Oct 10 17:15:27.784224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 353/716] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:27 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:27.850160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3ae2a6f9-e1df-48ba-a5bc-ab983ce32c1a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:27.858947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3ae2a6f9-e1df-48ba-a5bc-ab983ce32c1a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1242 microversion: 2.1 time: 0.098825 Oct 10 17:15:27.860150 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 364/717] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:27 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:28.782798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:28.783364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:28.790178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.790689 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.791373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.792454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.793151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.793796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.797114 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:28.797883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:28.806487 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.807122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.807712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.808558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.809087 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.809598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.905185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:28.912957 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-df0f3440-442b-40bd-82d9-bc8ed7be75e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.121129 Oct 10 17:15:28.914024 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 365/718] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:28 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:28.930163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:28.930784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:28.948943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.949693 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.950957 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.951768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:28.952450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:28.959175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:28.992233 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:29.000857 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b2266695-d601-4f09-bfd9-af77ef5851a3 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.221826 Oct 10 17:15:29.001486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 354/719] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:28 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:29.029081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:29.038655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-04f8f741-32be-43cf-8b8d-de644363d3c3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.120325 Oct 10 17:15:29.040155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 366/720] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:28 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:29.937734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:29.938421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:29.944902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:29.945388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:29.945820 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:29.946781 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:29.947218 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:29.947637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:30.013113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:30.020823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c4784a8b-212b-4c2d-b79f-080c7f5c6a6b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.086818 Oct 10 17:15:30.021536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 355/721] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:29 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:30.025900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:30.031132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:30.037867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:30.038476 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:30.039051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:30.040007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:30.040563 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:30.041059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:30.062905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:30.063610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:30.069514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:30.070183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:30.070758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:30.071873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:30.072685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:30.073108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:30.157163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:30.166628 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-35b85509-d2aa-4f43-947f-e5e179d2ed94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.107595 Oct 10 17:15:30.167227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 356/722] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:30 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:30.231172 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:30.238803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5c980302-f41c-4636-bc41-dc26f0718c61 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.216830 Oct 10 17:15:30.239357 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 367/723] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:30 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:31.044526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:31.045151 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:31.051562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.052066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.052501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.053185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.053630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.054049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.123011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:31.130778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-99674a59-bb08-4a62-9f15-9092712dbca8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.090720 Oct 10 17:15:31.131371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 357/724] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:31 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:31.190116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:31.190724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:31.197479 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.197965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.198399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.199090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.199538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.199957 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.261461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:31.262177 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:31.268464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.272078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.272273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:31.272391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.272391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:31.272391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:31.272391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:31.277907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5981da27-e76d-4ac7-bad3-48ea61af6362 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.091547 Oct 10 17:15:31.279635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 368/725] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:31 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:31.417623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:31.425997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ac17beda-635f-4ded-9ddd-960905645e08 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.168365 Oct 10 17:15:31.426566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 358/726] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:31 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:32.153749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:32.154280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:32.160803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.161295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.161732 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.162496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.162956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.163379 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.229370 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:32.237008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-512f8fbe-66e4-42b9-bf59-16cbb8e36d46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.087319 Oct 10 17:15:32.237584 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 369/727] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:32 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:32.306939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:32.307766 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:32.315170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.315658 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.316134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.316835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.317288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.317756 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.383662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:32.392410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8e5f20ef-d31c-42f1-9124-2766b90afcb2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.090102 Oct 10 17:15:32.393495 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 359/728] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:32 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:32.448358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:32.448978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:32.455151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.455629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.456073 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.456764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:32.457208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:32.457625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:32.597242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:32.615380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8206cc28-d4c1-4490-a187-7eca3393bf58 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.171071 Oct 10 17:15:32.616759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 370/729] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:32 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:33.260249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:33.261003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:33.267386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.267890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.268353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.269042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.269486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.269901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.336396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:33.347044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-03d4307f-30e6-4a55-99b6-ab8b1cbb699f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.090475 Oct 10 17:15:33.348484 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:33 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:33.414793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:33.449639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:33.449639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.449639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.449639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.450740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.450740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.450740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.534349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:33.542124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4cd9a9ae-9bbd-4904-8476-3b34a04eace1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.131097 Oct 10 17:15:33.542930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 371/731] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:33 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:33.641110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:33.641830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:33.662374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.662909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.663358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.664508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:33.665097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:33.665565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:33.820781 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:33.829142 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f53169e6-e479-4f6a-9727-4946f59280ea tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.194003 Oct 10 17:15:33.829701 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 361/732] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:33 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:34.378672 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:34.379276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:34.385219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.385696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.386122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.386795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.387235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.387648 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.448945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:34.456665 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b9fe324c-fd92-4c37-afd6-91bf398188ea tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1222 microversion: 2.1 time: 0.081870 Oct 10 17:15:34.457252 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 372/733] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:34 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:34.566326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:34.566868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:34.573154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.573629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.574083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.574790 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.575258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.575655 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.635193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:34.642635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d90bf8ce-72e5-4be3-82ad-69863cb71636 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1246 microversion: 2.1 time: 0.080255 Oct 10 17:15:34.643396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 362/734] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:34 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:34.851925 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:34.852559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:34.858920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.859408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.859841 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.860565 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:34.861006 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:34.861421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:34.991710 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:34.999933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-237f7369-2ee6-428c-990a-f4774dc1c5a5 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.151843 Oct 10 17:15:35.000530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:34 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:35.480238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:35.480849 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:35.483343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:35.488448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:35.488922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:35.489352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:35.490037 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:35.490475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:35.490890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:35.551135 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:35.559142 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-580ff28b-fd9c-40e4-933e-b10a6928615d tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1270 microversion: 2.1 time: 0.082720 Oct 10 17:15:35.559743 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 363/736] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:35 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:35.665060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:35.665715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:35.672908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:35.674544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:35.674544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:35.674888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:35.675177 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:35.675598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:35.741914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:35.750577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c2434b6a-48ec-44dd-abb8-bd8081a85080 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1238 microversion: 2.1 time: 0.089316 Oct 10 17:15:35.751137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 374/737] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:35 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:36.022880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:36.023486 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:36.031070 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.031547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.031976 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.032818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.033262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.033677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.169333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:36.177575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6a6eb12b-5dbe-4232-bcfe-682068afd89d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.158490 Oct 10 17:15:36.178149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 364/738] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:36 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:36.583655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:36.584295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:36.586097 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:36.590904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.591432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.591866 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.592577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.597574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.597574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.658235 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:36.665962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6bd737a4-2bbb-4765-a993-fc451cdb5320 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1278 microversion: 2.1 time: 0.086278 Oct 10 17:15:36.666521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 375/739] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:36 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:36.773698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:36.774260 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:36.776200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=18 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:36.780942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.781413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.781841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.782518 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:36.782959 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:36.783370 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:36.843636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:36.851146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a7794322-62dc-47ab-8d24-aec831d33c1f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1294 microversion: 2.1 time: 0.081350 Oct 10 17:15:36.851700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 365/740] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:36 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:37.200842 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:37.201477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:37.208084 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.208564 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.208991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.209664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.210110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.210522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.393409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:37.401015 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-67477c14-ca18-4d52-9d60-6e64f2eda93e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.204192 Oct 10 17:15:37.405243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 376/741] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:37 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:37.690053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:37.694298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:37.698438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.698923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.699369 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.700141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.700597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.701023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.793346 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:37.799715 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-10c7c115-304d-4e46-a25a-1d0cf427e002 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1276 microversion: 2.1 time: 0.114258 Oct 10 17:15:37.800331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 366/742] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:37 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:37.874349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:37.875109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:37.877124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=20 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:37.881984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.882469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.882904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.883595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:37.884069 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:37.884492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:37.949618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:37.953364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:37.960415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-698795f1-b274-4040-bb92-615e37c68fea tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1294 microversion: 2.1 time: 0.090701 Oct 10 17:15:37.962685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 377/743] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:37 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:38.424281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:38.425005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:38.434226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.434226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.434226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:38.434226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.435264 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.435586 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:38.626965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:38.630481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=100 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:38.636653 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-04838bbe-9fbd-4a27-b678-581b2eb25a2c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.216336 Oct 10 17:15:38.637303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 367/744] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:38 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:38.824159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:38.824781 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:38.831965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.832476 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.832908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:38.833602 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.834053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.834471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:38.985830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:38.986621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:38.993138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.993710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.994154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:38.994854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:38.995309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:38.995738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:39.056559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:39.065907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-001e97d3-1e89-49b2-92ea-11b344295f4f tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.246264 Oct 10 17:15:39.067215 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 378/745] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:38 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:39.081420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:39.090111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d055c505-e277-405b-851c-6f651ba42ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1300 microversion: 2.1 time: 0.108042 Oct 10 17:15:39.090725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 368/746] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:38 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:39.432888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ddc1e2-75ec-4645-9197-7ed0252088fa", "tag": "ee82f317-96ee-436f-8109-f4a53dde9815"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:39.455776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:39.464521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:39.464521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:39.488249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] Creating event network-changed:ee82f317-96ee-436f-8109-f4a53dde9815 for instance e6ddc1e2-75ec-4645-9197-7ed0252088fa on hv-cinder-83454 Oct 10 17:15:39.496602 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-0d0354be-04c2-451a-9efe-7b0ccaf40268 req-1aa2ecf7-7d02-4f10-9983-b058c7362729 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068366 Oct 10 17:15:39.504187 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 379/747] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:39.662559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:39.662875 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:39.674184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:39.676275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:39.676722 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:39.677448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:39.677900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:39.678318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.092212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:40.093102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:40.100480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:40.101286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:40.101785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.102556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:40.103199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:40.103950 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.133399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:40.146146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a59d7688-4c69-4e9c-9470-09efd1337b10 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.487837 Oct 10 17:15:40.146971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 369/748] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:39 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:40.164475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:40.165359 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:40.173086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:40.173682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:40.174388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.175277 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:40.175841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:40.176388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.329408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:40.340333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b2081c0a-f427-4055-8ae0-113c077c05e1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.253146 Oct 10 17:15:40.341174 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 380/749] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:40 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:40.457308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:40.465008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9d6bb94d-9f65-4fb3-b974-25b5199bec19 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.311634 Oct 10 17:15:40.465578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 370/750] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:40 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:40.496788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622151bc-b582-4981-a615-3839765b0b75", "tag": "4d8540fa-63ed-42d6-8d51-362073b36af2"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:40.508325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:40.509562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:40.510064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:40.522224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] Creating event network-changed:4d8540fa-63ed-42d6-8d51-362073b36af2 for instance 622151bc-b582-4981-a615-3839765b0b75 on hv-cinder-83454 Oct 10 17:15:40.527973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-62c60998-6345-4c9e-97e5-9ba0d7bba647 req-5de5b4f3-247d-4e01-8aa4-a22b1a948a01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034938 Oct 10 17:15:40.529449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 381/751] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:41.169389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:41.170023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:41.176926 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.177400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.177827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.178505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.178947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.179362 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.303763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:41.311373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bc5946e8-c089-4c85-b773-3133a359daca tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.145854 Oct 10 17:15:41.311953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 371/752] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:41 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:41.365145 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:41.365852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:41.371962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.372482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.372920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.373609 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.374066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.374518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.488002 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:41.488909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:41.494801 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.495286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.495718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.496432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.496878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.497296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.510646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:41.516943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-11cc6ef3-6a66-43a6-adae-b03e60032967 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.156422 Oct 10 17:15:41.517824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 382/753] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:41 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:41.615413 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "name": "network-vif-plugged", "status": "completed", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:41.622631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:41.626467 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:41.626941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:41.627365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:41.630954 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:41.638188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] Creating event network-vif-plugged:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:15:41.638443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b49d0aca-2833-4cd9-9a5b-abacb78ee311 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.154256 Oct 10 17:15:41.639008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 372/754] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:41 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:41.657050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-e50d1d43-e88f-4db0-8e60-598cf8add76e req-60cf410e-7fce-4498-a646-46397008ea1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047254 Oct 10 17:15:41.657625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 383/755] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:15:42.334434 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:42.334972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:42.341353 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.341825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.342251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.343544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.343993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.344438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.471282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:42.479062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-981dbebe-a72d-4c33-81bf-8a19992f429a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.148571 Oct 10 17:15:42.479631 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 373/756] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:42 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:42.540812 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:42.541513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:42.548281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.548768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.549265 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.549948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.550397 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.550823 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.661532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:42.662184 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:42.668216 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.668704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.669143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.669865 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:42.670319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:42.670775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:42.683216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:42.691337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-83a02e96-6d72-4729-ab89-a5d0676c383e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.155227 Oct 10 17:15:42.691904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 384/757] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:42 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:42.797178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:42.804683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-40264f14-cd8b-4739-8797-3e8a1a23ea1e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.147100 Oct 10 17:15:42.805245 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 374/758] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:42 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:43.503112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:43.503751 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:43.509749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.510228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.510656 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.511342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.511790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.512233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.640208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:43.648103 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-32c87efa-c1d3-4080-a23e-9b16ad9f287c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1359 microversion: 2.1 time: 0.149617 Oct 10 17:15:43.648671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 385/759] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:43 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:43.714513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:43.715122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:43.722075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.722553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.722982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.723660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.724133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.724550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.828756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:43.829487 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:43.835739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.836259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.836691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.837387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:43.837882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:43.838251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:43.855794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:43.864008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-02377b52-b631-49b1-995e-481377679b48 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.153233 Oct 10 17:15:43.865287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 375/760] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:43 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:43.981035 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:43.989076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-77cc70c4-6a01-4709-a1c9-0514503bd2d1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.164825 Oct 10 17:15:43.989644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 386/761] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:43 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:44.671998 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:44.672661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:44.678587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.679066 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.679501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:44.680226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.680678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.681100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:44.809148 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:44.816832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4b9b0913-a0c0-4521-ba9f-fe594767d3f1 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1548 microversion: 2.1 time: 0.149191 Oct 10 17:15:44.817404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 376/762] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:44 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:44.839347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:44.839945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:44.847203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.847716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.848216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:44.848944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.849424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.849848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:44.886773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:44.887385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:44.893407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.893901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.894327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:44.895015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:44.895524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:44.895949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.023689 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:45.032048 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-56281808-d354-4da9-88a1-d54859e00939 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1548 microversion: 2.1 time: 0.196644 Oct 10 17:15:45.032617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 387/763] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:44 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:45.044208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:45.044208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:45.044208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.044208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.044624 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.048793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.048793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.048793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.057688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:45.065970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-da44ccfb-565f-4444-a0d0-b5a1b6d2361c tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.183052 Oct 10 17:15:45.066541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 377/764] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:44 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:45.070915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:45.076577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:45.078018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Searching by: {'deleted': False, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e'} {{(pid=119264) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 17:15:45.081964 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:45.085235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.085706 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.086129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.086837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.087279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.087791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.179991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.multi_cell_list [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119264) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 17:15:45.181825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:45.189727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4cd068a0-f129-4ddf-b78f-601a43fd796d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.156129 Oct 10 17:15:45.190322 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 388/765] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:45 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:45.272664 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a16e2d00-4918-4fdb-9a73-30cae1277eb8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205086 Oct 10 17:15:45.273242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 378/766] 10.222.0.42 () {58 vars in 1125 bytes} [Mon Oct 10 17:15:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:45.285955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:45.286562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:45.292471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.292956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.293393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.294078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.294533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.294957 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.420505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:45.428186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5b9fb2e5-b73a-4eb9-a991-d2fae5113edb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1548 microversion: 2.1 time: 0.146036 Oct 10 17:15:45.428758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 389/767] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:45 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:45.732543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ddc1e2-75ec-4645-9197-7ed0252088fa", "name": "network-vif-plugged", "status": "completed", "tag": "ee82f317-96ee-436f-8109-f4a53dde9815"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:45.746599 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:45.747068 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:45.747497 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:45.762754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] Creating event network-vif-plugged:ee82f317-96ee-436f-8109-f4a53dde9815 for instance e6ddc1e2-75ec-4645-9197-7ed0252088fa on hv-cinder-83454 Oct 10 17:15:45.768687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-25722d77-aec8-4091-b3e3-a32640ead0e1 req-f3b08810-ce04-4481-a959-f6c727712cb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039845 Oct 10 17:15:45.769289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 379/768] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:46.091109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:46.092132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:46.099152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:46.099962 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:46.100416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:46.101283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:46.101963 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:46.102591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:46.214150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:46.215566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:46.223471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:46.224266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:46.224887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:46.225903 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:46.227420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:46.228329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:46.260903 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:46.270386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d8903e2b-3438-44a2-ad99-0875c0c6c579 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.184066 Oct 10 17:15:46.271074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 390/769] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:46 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:46.376988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:46.385110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9d1dd941-4c2e-4b28-a4e9-26c53184067d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.175211 Oct 10 17:15:46.386208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 380/770] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:46 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:47.293327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:47.294037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:47.296565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c93647-37e7-4e9c-beb0-ca8e20227e61"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:47.298838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:47.301204 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.301756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.302277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.303000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.303447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.303866 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.305250 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.305739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.306182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.306873 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.307326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.307759 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.444054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:47.448077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e06ca366-f3eb-493a-ac29-b177221a6091 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1318 microversion: 2.1 time: 0.158639 Oct 10 17:15:47.448924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 391/771] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:47 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:47.453468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:47.454179 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:47.459900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.465355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.465355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.465355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.465355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.466047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.590681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:47.598411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-53a6f624-f25c-4672-afad-141e19899544 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.148526 Oct 10 17:15:47.598956 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 392/772] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:47 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:47.782801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622151bc-b582-4981-a615-3839765b0b75", "name": "network-vif-plugged", "status": "completed", "tag": "4d8540fa-63ed-42d6-8d51-362073b36af2"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:47.792124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:47.792596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:47.793032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:47.804638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] Creating event network-vif-plugged:4d8540fa-63ed-42d6-8d51-362073b36af2 for instance 622151bc-b582-4981-a615-3839765b0b75 on hv-cinder-83454 Oct 10 17:15:47.809396 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-16b0a301-6020-4012-a2ca-0c48c323941b req-a6dd091e-2f4e-4dc8-97dc-f6a2977cfd79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030878 Oct 10 17:15:47.809965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 393/773] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:15:48.471475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:48.472894 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:48.479515 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:48.486246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:48.486246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:48.486246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:48.486246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:48.486625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:48.597923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-704338f1-809f-4b79-bfe0-bb3a5372125d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.305742 Oct 10 17:15:48.598661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 381/774] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:15:47 2022] POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments => generated 194 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:15:48.610582 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:48.618676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0936b025-04ed-4183-8e41-69f739db26ee tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1506 microversion: 2.1 time: 0.151679 Oct 10 17:15:48.636330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 394/775] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:48 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:48.636812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:48.636812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:48.636812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:48.636812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:48.637178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:48.637178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:48.637178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:48.637178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:48.780765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:48.788363 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8f2b7fe4-5fec-4ea0-b189-4334aabb4f4e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1368 microversion: 2.1 time: 0.169870 Oct 10 17:15:48.788918 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 382/776] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:48 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:49.811298 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:49.811960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:49.818535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:49.819018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:49.819449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:49.820162 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:49.820613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:49.821034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:49.957320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:49.965069 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-904264bd-1ec7-47e8-abb4-f7a3f663862f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1558 microversion: 2.1 time: 0.157764 Oct 10 17:15:49.965667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 395/777] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:49 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:15:49.988364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:49.988998 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:49.995528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:49.996100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:49.996522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:49.997251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:49.997748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:49.998205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:50.017040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:50.078871 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f21c9239-26cc-449e-9da6-f82dab1c5400 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094612 Oct 10 17:15:50.079465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 383/778] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:15:49 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:51.074637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622151bc-b582-4981-a615-3839765b0b75", "tag": "4d8540fa-63ed-42d6-8d51-362073b36af2"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:51.084953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:51.085426 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:51.085860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:51.098444 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] Creating event network-changed:4d8540fa-63ed-42d6-8d51-362073b36af2 for instance 622151bc-b582-4981-a615-3839765b0b75 on hv-cinder-83454 Oct 10 17:15:51.103432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-a95702ad-f823-4118-8331-afe7c0554cee req-7fb4216f-c5ef-4c1e-9631-4353f7e62d44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032870 Oct 10 17:15:51.104485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 396/779] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:15:57.251391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:15:57.255854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:15:57.256606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:15:57.263343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:57.263832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:57.264289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:57.265495 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:57.270281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:57.270281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:57.405616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:15:57.414356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-71d9d637-db2e-426a-a34f-7986bfd4c569 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1594 microversion: 2.1 time: 0.164263 Oct 10 17:15:57.414923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 384/780] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:15:57 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:15:59.410709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:15:59.421934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:15:59.422663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:15:59.423292 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:15:59.442505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] Creating event network-changed:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:15:59.442505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-a6f0cc69-5c1e-4849-8908-6744042e1ea6 req-61a4874f-634d-4448-810d-117f2e1b6b4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Oct 10 17:15:59.444145 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 397/781] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:01.735141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1292890992"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:01.738115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:01.742211 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:01.742637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:01.743069 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:01.743755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:01.744240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:01.744668 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:01.867705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.network.security_group_api [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Adding security group eb31bbfb-c53e-4db8-a4ad-3089329857db to port b6c7057f-178b-49ef-a993-8f7df4dcbcbf Oct 10 17:16:02.218334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0075e0dd-18ce-41c3-a620-f3519ffa011f tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action" status: 202 len: 0 microversion: 2.1 time: 0.487114 Oct 10 17:16:02.219205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 385/782] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:16:01 2022] POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:16:02.227263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:02.227814 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:02.228299 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:02.234711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:02.235200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:02.235629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:02.236354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:02.237380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:02.237823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:02.238471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:02.238953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:02.239378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:02.250818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] Creating event network-changed:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:16:02.256079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-d1e45eb7-e19e-4ba7-a354-cfeb86f16167 req-34d7c1a9-abb7-45b3-969c-c24b536282ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033009 Oct 10 17:16:02.256669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 398/783] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:16:02.396464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:02.404917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-dd886f89-5848-4bfd-9124-ba9a7d2c4fec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1641 microversion: 2.1 time: 0.181307 Oct 10 17:16:02.406096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 386/784] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:02 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1641 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:07.432116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1383428973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764167818", "security_groups": [{"name": "tempest-secgroup-smoke-1574135174"}], "block_device_mapping_v2": [{"uuid": "130dab2c-f371-44d4-b16f-94c8fd664799", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d40eb576-47ec-4491-b3a9-6394e24cb47e"}]}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:07.553144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] validate_networks() for [('d40eb576-47ec-4491-b3a9-6394e24cb47e', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:16:08.137802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:16:08.138216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:16:08.138681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:16:08.139080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:16:08.139482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:16:08.148195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:08.148673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:08.149393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:08.150111 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:08.150558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:08.150991 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:08.158075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=100 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:08.168785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:16:08.173363 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Getting quotas for user d625c099d9134f78b3e8940879c19106 and project c36e0d86e93942189945656ccb70c059. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:16:08.228789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:16:08.231007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='130dab2c-f371-44d4-b16f-94c8fd664799',volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:16:08.635716 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6733e370-c383-462b-aa2b-0d321e0f03f4 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207792 Oct 10 17:16:08.636432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 399/785] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:16:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:16:08.647327 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d74c44ae-45a2-4833-802f-94e830cc9d8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:08.647934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d74c44ae-45a2-4833-802f-94e830cc9d8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:08.700577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d74c44ae-45a2-4833-802f-94e830cc9d8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:08.707309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d74c44ae-45a2-4833-802f-94e830cc9d8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1094 microversion: 2.1 time: 0.063758 Oct 10 17:16:08.707875 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 387/786] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:08 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:09.730376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:09.731013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:09.737837 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:09.738343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:09.738777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:09.739461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:09.739910 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:09.740364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:09.800796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:09.808485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5f7c38d3-8837-496d-a9a5-44c92f0799a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1144 microversion: 2.1 time: 0.082589 Oct 10 17:16:09.809045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 400/787] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:09 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:10.481432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d93545ba-22b0-494d-9778-f25fda878534", "device": "/dev/sdb"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:10.484329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:10.492221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:10.496136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:10.496136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:10.496136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:10.496136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:10.496507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:10.831194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:10.831801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:10.838121 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:10.838601 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:10.839033 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:10.839735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:10.840214 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:10.840637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:10.902829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:10.910704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-28a2e4b9-b353-4d77-b24a-c0f3562765a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1200 microversion: 2.1 time: 0.083888 Oct 10 17:16:10.914821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 401/788] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:10 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:11.147265 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-76715187-4cba-4171-b0eb-5d303b3c694e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "POST /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669603 Oct 10 17:16:11.147971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 388/789] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:16:10 2022] POST /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:11.933333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:11.933982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:11.940518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:11.944249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:11.944249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:11.944249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:11.944249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:11.944639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:12.082357 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:12.090700 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f720033a-48c3-4910-acd0-d7e5e52a153f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1278 microversion: 2.1 time: 0.161199 Oct 10 17:16:12.094251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 402/790] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:11 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:12.578314 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbabe562-2556-478f-995a-56dc3e6309b4", "tag": "f141f1b5-a360-478a-9824-c75871e9cee8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:12.590094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:12.590578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:12.591004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:12.602150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] Creating event network-changed:f141f1b5-a360-478a-9824-c75871e9cee8 for instance dbabe562-2556-478f-995a-56dc3e6309b4 on hv-cinder-83454 Oct 10 17:16:12.606923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-76b183ef-7f44-491a-aa42-41494af86ec9 req-76d42299-51ac-4775-a2be-b10153688471 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032659 Oct 10 17:16:12.607728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 389/791] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:13.115507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:13.116240 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:13.118479 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:13.123497 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:13.124003 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:13.124464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:13.125195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:13.126259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:13.126777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:13.267658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:13.275375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d1660100-567c-4554-ab94-43ae2b642b23 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.163852 Oct 10 17:16:13.275971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 403/792] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:13 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:14.299815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:14.300535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:14.306640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:14.307123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:14.307556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:14.308269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:14.308719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:14.309140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:14.440564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:14.448583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b5278de1-6d29-497b-a37a-73ff6279e7f7 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.153843 Oct 10 17:16:14.451741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 390/793] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:14 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:15.470443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:15.475035 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:15.477396 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:15.477884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:15.478321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:15.479005 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:15.479474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:15.479878 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:15.607289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:15.614931 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5a9d0b82-5023-448c-95c7-1a002ed1cb7e tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.148251 Oct 10 17:16:15.615489 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 404/794] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:15 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:16.637937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:16.638544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:16.640913 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=27 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:16.646099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:16.646576 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:16.647014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:16.647700 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:16.648182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:16.648606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:16.778479 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:16.786646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-93b0b25b-7d5d-4462-864d-b1d966f3bf42 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.152713 Oct 10 17:16:16.787206 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 391/795] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:16 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:17.809004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:17.809520 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:17.815860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:17.816453 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:17.816888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:17.817566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:17.818012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:17.818426 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:17.946800 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:17.952897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-89305fa7-96e1-4aa4-928a-46ff45f4f40d tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.147798 Oct 10 17:16:17.953459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 405/796] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:17 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:18.976041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:18.976660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:18.978961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:18.983701 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:18.984222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:18.984684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:18.985383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:18.985820 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:18.986241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:19.116463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:19.123943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-87663979-c386-4a62-a485-62b51f5876a5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.151739 Oct 10 17:16:19.124517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 392/797] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:18 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:20.146949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:20.147557 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:20.149386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:20.150032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=6 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:20.155190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:20.155675 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:20.156141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:20.156825 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:20.157277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:20.157698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:20.294883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:20.303546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bb63c41c-54fa-449a-837d-ce2ec4ea45d3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.161067 Oct 10 17:16:20.304149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 406/798] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:20 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:21.328750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:21.328750 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:21.334371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:21.334861 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:21.335297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:21.335992 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:21.336469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:21.336894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:21.472733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:21.480595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ef063878-2393-4280-98f0-b22083d5c31b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.157718 Oct 10 17:16:21.481229 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 393/799] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:21 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:22.503063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:22.503632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:22.510030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:22.510509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:22.510942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:22.511624 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:22.512094 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:22.512518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:22.642596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:22.650609 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-05addf7c-f98d-4f5e-ba83-8a0d7528fb8a tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.151568 Oct 10 17:16:22.651164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 407/800] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:22 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:23.673572 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:23.674180 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:23.680682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:23.681164 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:23.681599 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:23.682288 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:23.682737 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:23.683156 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:23.810766 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:23.818688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3ee1c66d-ac32-48f8-817f-596dba4d5294 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.148994 Oct 10 17:16:23.819248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 394/801] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:23 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:24.842148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:24.843285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:24.849232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:24.849720 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:24.850149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:24.850843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:24.851284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:24.852759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:24.983739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:24.992301 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ce7c75cf-8b59-47c8-b92d-12af8357c765 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.154279 Oct 10 17:16:24.992873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 408/802] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:24 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:25.367660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbabe562-2556-478f-995a-56dc3e6309b4", "name": "network-vif-plugged", "status": "completed", "tag": "f141f1b5-a360-478a-9824-c75871e9cee8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:25.379391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:25.379883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:25.380367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:25.546683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] Creating event network-vif-plugged:f141f1b5-a360-478a-9824-c75871e9cee8 for instance dbabe562-2556-478f-995a-56dc3e6309b4 on hv-cinder-83454 Oct 10 17:16:25.551692 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-06382c4c-6c48-4635-ae4a-e339d710a87f req-050a6f91-871f-4a27-8b58-8548078bb814 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188281 Oct 10 17:16:25.552385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 395/803] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:26.014645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:26.015250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:26.022957 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:26.023447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:26.023884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:26.024609 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:26.025078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:26.025502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:26.159077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:26.166762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a1dbc3fe-a1bc-48c5-9aa4-1d3dc3f3ef5c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.155876 Oct 10 17:16:26.167326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 409/804] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:26 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:27.190811 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:27.191509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:27.197901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:27.198395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:27.198833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:27.199518 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:27.199969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:27.200417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:27.327939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:27.330235 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:27.336879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-88047788-ef0c-4dc9-93bf-9222afc7d1f9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.150820 Oct 10 17:16:27.337437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 396/805] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:27 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:28.372265 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:28.372895 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:28.379213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:28.379688 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:28.380147 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:28.380853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:28.381299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:28.381730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:28.512982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:28.520584 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fb8ba76c-adf5-4e15-bf55-05174f39b5ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.152217 Oct 10 17:16:28.521658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 410/806] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:28 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:29.543433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:29.544057 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:29.551249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:29.551760 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:29.552894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:29.553585 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:29.554055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:29.554478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:29.681900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:29.689416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-029e1309-a3ac-4209-b40e-a9b53b38852f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1266 microversion: 2.1 time: 0.150033 Oct 10 17:16:29.689969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 397/807] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:29 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:30.712787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:30.713393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:30.719902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:30.720481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:30.720914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:30.721598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:30.722045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:30.722464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:30.853927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:30.861617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2a8f8f9a-c966-4d36-802c-8b5937d46b1b tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1454 microversion: 2.1 time: 0.153209 Oct 10 17:16:30.862190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 411/808] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:30 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:30.883421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:30.884005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:30.890387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:30.890876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:30.891307 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:30.891991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:30.892467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:30.892887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:31.020187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:31.027797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e3393be2-2bb0-4fc4-abc3-055a3ae359b5 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1454 microversion: 2.1 time: 0.148256 Oct 10 17:16:31.028397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 398/809] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:30 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:32.988216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbabe562-2556-478f-995a-56dc3e6309b4", "tag": "f141f1b5-a360-478a-9824-c75871e9cee8"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:32.998052 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:32.998525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:32.999009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:33.009700 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] Creating event network-changed:f141f1b5-a360-478a-9824-c75871e9cee8 for instance dbabe562-2556-478f-995a-56dc3e6309b4 on hv-cinder-83454 Oct 10 17:16:33.017245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-7e047716-baea-4c69-b776-3b2794b1fb75 req-e7ee9060-1a58-4e0d-84af-5fb6c58d4dfa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030154 Oct 10 17:16:33.017245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 412/810] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:38.025953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:38.026522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:38.032846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:38.033341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:38.033754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:38.034441 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:38.034886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:38.035311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:38.114680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lazy-loading 'services' on Instance uuid e6ddc1e2-75ec-4645-9197-7ed0252088fa {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:16:38.354044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-76876653-6be8-444a-bf19-385356c7c052 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa/os-volume_attachments/d93545ba-22b0-494d-9778-f25fda878534" status: 202 len: 0 microversion: 2.1 time: 0.331612 Oct 10 17:16:38.355138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 399/811] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:16:38 2022] DELETE /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa/os-volume_attachments/d93545ba-22b0-494d-9778-f25fda878534 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:16:40.542062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:40.542746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:40.554176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:40.554176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:40.554176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:40.554176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:40.554533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:40.554533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:40.555029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=75 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:40.579637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:16:40.873834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f84f85cf-5faf-4957-b85c-7b8632a999f1 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 204 len: 0 microversion: 2.1 time: 0.336554 Oct 10 17:16:40.874450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 413/812] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:16:40 2022] DELETE /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:16:40.883918 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:40.884659 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:40.891130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:40.891618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:40.892072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:40.892801 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:40.893252 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:40.893676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:41.021493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:41.029128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-91f218c1-44c2-47ac-8640-11cfc728c6c3 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1512 microversion: 2.1 time: 0.150264 Oct 10 17:16:41.029682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 400/813] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:40 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:42.054210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:42.054929 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:42.059251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:42.061590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.061731 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:42.062076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.062509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.063201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.063651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.064089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.067956 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.068467 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.068900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.069582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.070027 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.070472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.198389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:42.206014 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d64bf98a-97c6-4601-9411-2c3eb59dba46 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1512 microversion: 2.1 time: 0.156075 Oct 10 17:16:42.206579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 414/814] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:42 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:42.278362 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-94f3588b-e873-46d3-81cd-ef23a83e6c68 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action" status: 202 len: 0 microversion: 2.1 time: 0.222807 Oct 10 17:16:42.278986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 401/815] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:16:42 2022] POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:16:42.286683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:42.287285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:42.293797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.294436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.294875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.295561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:42.296011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:42.296458 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:42.435037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:42.443397 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e47a7e0c-904c-45f3-8083-eedf0809ed7c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1751 microversion: 2.1 time: 0.160384 Oct 10 17:16:42.443965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 415/816] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:42 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:43.230161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:43.231149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:43.238175 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:43.238549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:43.239537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:43.239808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:43.240344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:43.241223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:43.395997 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:43.403745 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-606f149e-c041-4250-8e90-fb7ef5402067 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1512 microversion: 2.1 time: 0.177786 Oct 10 17:16:43.404560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 402/817] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:43 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:43.466944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:43.467686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:43.473514 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:43.475239 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:43.475958 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:43.476507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:43.477333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:43.477980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:43.478496 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:43.516690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ddc1e2-75ec-4645-9197-7ed0252088fa", "name": "network-vif-deleted", "tag": "ee82f317-96ee-436f-8109-f4a53dde9815"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:43.527389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:43.528178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:43.528644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:43.540274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] Creating event network-vif-deleted:ee82f317-96ee-436f-8109-f4a53dde9815 for instance e6ddc1e2-75ec-4645-9197-7ed0252088fa on hv-cinder-83454 Oct 10 17:16:43.545600 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-1adb6a3d-e7d5-4432-9715-a1ecb4398ade req-8c96669b-b939-4f0d-b43c-e58b9ee9340b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Oct 10 17:16:43.546651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 403/818] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:43.638829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:43.647501 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-30e7db06-13a0-4988-a089-ee9e2d140490 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1751 microversion: 2.1 time: 0.184624 Oct 10 17:16:43.652281 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 416/819] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:43 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:44.427085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:44.427769 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:44.434306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:44.439041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:44.439041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:44.439041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:44.439041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:44.439413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:44.467406 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:44.467871 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:44.468336 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:44.468772 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lazy-loading 'fault' on Instance uuid e6ddc1e2-75ec-4645-9197-7ed0252088fa {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:16:44.512626 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:44.520456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ece650bf-556c-409e-a5f7-1605a1f9ae32 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 200 len: 1308 microversion: 2.1 time: 0.097601 Oct 10 17:16:44.521273 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 404/820] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:44 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:44.673677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:44.674258 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:44.680746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:44.681227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:44.681683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:44.682364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:44.682862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:44.683282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:44.974474 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:44.982637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-43336502-7bd0-4bee-9b78-464aad8caabb tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.313171 Oct 10 17:16:44.983200 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 417/821] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:44 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:45.544605 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:45.545140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: e6ddc1e2-75ec-4645-9197-7ed0252088fa] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:45.551623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:45.552131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:45.552584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:45.553945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:45.554397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:45.554812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:45.567637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] HTTP exception thrown: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Request method failure captured: Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa HTTP/1.1 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqpSO6OfRu4UnZHNu2NqhVMYPGFMARo__egBMy--lVsijcnUhHqRiFXbyE0khcDf49xN0kucGRGRH40v8SEXs5hn50Bwr5F_-ZLPtZ1BGbWP7SCLLseaXq3djy4an0IRbRaOimNjXqtbQlT0XDa9Uo4ya_P-DF_jEqqKOWOx1veQM Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: b9422ce68e164e7d8ae8dbf168e58e78 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:16:45.569326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9422ce68e164e7d8ae8dbf168e58e78"}]}] Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: b9422ce68e164e7d8ae8dbf168e58e78 Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesSnapshotTestJSON-1198335059-project Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: a800d4a53c234d2fa53eeb0c68163f44 Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesSnapshotTestJSON-1198335059-project Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. Oct 10 17:16:45.570949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'e6ddc1e2-75ec-4645-9197-7ed0252088fa'} Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:16:45.572044 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. Oct 10 17:16:45.573822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:16:45.575179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Returning 404 to user: Instance e6ddc1e2-75ec-4645-9197-7ed0252088fa could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:16:45.575179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0ad6fc03-f197-4df0-898b-298584e8bcb6 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa" status: 404 len: 111 microversion: 2.1 time: 0.030066 Oct 10 17:16:45.575179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 405/822] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:45 2022] GET /compute/v2.1/servers/e6ddc1e2-75ec-4645-9197-7ed0252088fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:16:46.007185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:46.007787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:46.014328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:46.014817 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:46.015305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:46.015996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:46.016530 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:46.017078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:46.160218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:46.168314 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a499b42b-8c63-4116-b8d4-d9d4e7a6a5a8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.165494 Oct 10 17:16:46.171774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 418/823] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:46 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:46.224651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:46.225173 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:46.231000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:46.231472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:46.231900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:46.232602 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:46.233045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:46.233461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:46.255503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f61b7ecf-1466-4f98-aeaa-e016c2d2e6ae tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/ips" status: 200 len: 150 microversion: 2.1 time: 0.034751 Oct 10 17:16:46.256549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 406/824] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:16:46 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:47.192002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:47.192639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:47.199137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:47.199620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:47.200142 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:47.200829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:47.201282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:47.201702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:47.345856 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:47.354552 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e6a47a3e-893e-4200-832f-cfcc843bc8ac tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.166425 Oct 10 17:16:47.355098 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 419/825] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:47 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:48.377699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:48.378298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:48.380711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=34 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:48.385929 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:48.386405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:48.386838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:48.387521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:48.387986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:48.388408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:48.528398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:48.536485 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0d133436-fc4c-4c79-a733-7c1554111e9a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.162654 Oct 10 17:16:48.537046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 407/826] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:48 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:49.559610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:49.560246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:49.566836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:49.567322 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:49.567758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:49.568487 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:49.568984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:49.569408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:49.713269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:49.721508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b05c0fcd-6bb2-4862-a341-8834228d2a7d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.165777 Oct 10 17:16:49.722063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 420/827] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:49 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:50.079909 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:50.082393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:50.089521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:50.090008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:50.090405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:50.091114 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:50.091537 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:50.092155 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:50.746164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:50.746761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:50.753276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:50.753761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:50.754197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:50.754887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:50.755341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:50.755766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:50.810096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2d9dda7e-4f45-4c5f-a2df-756b68f1edab tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733763 Oct 10 17:16:50.810815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 408/828] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:16:50 2022] POST /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:50.902181 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:50.910380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-555faa77-881c-44ef-8eec-daf66bae789d tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.168083 Oct 10 17:16:50.910932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 421/829] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:50 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:16:51.936200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:51.936889 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:51.942921 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:51.943400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:51.944413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:51.945099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:51.945572 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:51.945991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:52.089718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:52.097830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0d8bee07-5767-4ed1-a413-f153c2ad80ec tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.166732 Oct 10 17:16:52.098382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 409/830] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:51 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:16:53.121282 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:53.121843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:53.128167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:53.128662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:53.129079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:53.129758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:53.130206 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:53.130632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:53.268048 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:53.276647 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1cd04a67-952c-40a7-9f6d-287bd81c0b50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.159362 Oct 10 17:16:53.277202 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 422/831] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:53 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:54.300341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:54.300898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:54.307990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:54.308504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:54.308944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:54.309633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:54.310085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:54.310543 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:54.451300 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:54.459481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2d190195-e1e6-401c-b65d-5d589e7a70e8 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.163097 Oct 10 17:16:54.460063 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 410/832] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:54 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:55.483708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:55.484341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:55.490219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:55.491207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:55.491633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:55.492338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:55.492784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:55.493201 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:55.632332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:55.640351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-80dfd1db-4da5-4a8b-b8d6-d0ae2dc76139 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.160687 Oct 10 17:16:55.640903 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 423/833] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:55 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:55.900676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2137599533", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "networks": [{"uuid": "e8f36e2a-b122-4a19-98f7-7d10c957a7f1"}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:55.953826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] validate_networks() for [('e8f36e2a-b122-4a19-98f7-7d10c957a7f1', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:16:56.291503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:16:56.291927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:16:56.292442 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:16:56.292853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:16:56.293297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:16:56.302013 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:56.302493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:56.302970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:56.303734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:56.304221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:56.304649 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:56.321194 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Getting quotas for project b9422ce68e164e7d8ae8dbf168e58e78. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:16:56.325337 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Getting quotas for user a800d4a53c234d2fa53eeb0c68163f44 and project b9422ce68e164e7d8ae8dbf168e58e78. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:16:56.336677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:16:56.339000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:16:56.504018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fbbad64e-14cf-42f8-a9ec-fb46d48fa3c5 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607084 Oct 10 17:16:56.504671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 411/834] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:16:56.516438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-29f80973-0070-4530-8064-52b5a8edec8e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:56.517050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-29f80973-0070-4530-8064-52b5a8edec8e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:56.570159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-29f80973-0070-4530-8064-52b5a8edec8e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:56.577298 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-29f80973-0070-4530-8064-52b5a8edec8e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1219 microversion: 2.1 time: 0.064711 Oct 10 17:16:56.577859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 424/835] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:56 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:56.663535 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:56.664177 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:56.670444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:56.670922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:56.671355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:56.672067 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:56.672577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:56.673000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:56.687723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:16:56.817852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:56.826686 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9d20011f-0eee-49f2-9bfc-47b355a5f71a tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.166944 Oct 10 17:16:56.827254 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 412/836] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:56 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:57.599699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:57.600783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:57.607963 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:57.608532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:57.608967 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:57.609646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:57.610126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:57.610546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:57.671280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:57.678796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-619cbbda-b7f3-4afb-8143-75b71e28dc12 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1223 microversion: 2.1 time: 0.083015 Oct 10 17:16:57.679351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 425/837] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:57 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:57.851323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:57.851893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:57.858796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:57.859276 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:57.859718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:57.860429 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:57.860879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:57.861305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:58.000679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:58.009419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-cf18a0c2-d78b-4ee8-9e00-0858de021951 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.162701 Oct 10 17:16:58.009990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 413/838] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:57 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:58.348950 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c6fcd6d4-d820-442e-beae-0a790c87022e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: .version_select at 0x7f34ef40fa60>, body: {"keypair": {"name": "tempest-keypair-1687585322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXCAaOaRF4HpMifJGfdCAKSqN6s+efDj0RUt77mYorF9KKrNNBeizwoTVAFtxv7AgajKtUzln+h64py1tOIvHP4J8HP192wkxhT8LgTtHjgfy5IO7oMZPfZ7tBYf4+0Gw=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:16:58.366208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-c6fcd6d4-d820-442e-beae-0a790c87022e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:16:58.370197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-c6fcd6d4-d820-442e-beae-0a790c87022e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:16:58.441251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c6fcd6d4-d820-442e-beae-0a790c87022e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096293 Oct 10 17:16:58.441913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 426/839] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:16:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:16:58.701335 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:58.701993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:58.707934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:58.708456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:58.708893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:58.709590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:58.710021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:58.710618 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:58.775633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:58.783349 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fbcd39c7-a322-4c17-aff1-cfcb68fb2d72 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1271 microversion: 2.1 time: 0.086172 Oct 10 17:16:58.783907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 414/840] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:58 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:16:59.033094 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:59.033703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:59.040238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:59.040721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:59.041163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:59.041833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:59.042280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:59.042694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:59.509705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:59.518459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1837b564-30d9-498c-b647-1f37c8e8376c tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.489280 Oct 10 17:16:59.518573 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 427/841] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:59 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:16:59.807549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:16:59.808203 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:16:59.814697 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:59.815415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:59.815854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:59.816588 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:16:59.817041 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:16:59.817593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:16:59.895983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:16:59.904638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3c60a21c-5253-440f-9b0b-3bbb188bd4c2 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1277 microversion: 2.1 time: 0.101725 Oct 10 17:16:59.920593 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 415/842] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:16:59 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:00.541704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:00.545583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:00.549512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:00.549654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064371498", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0"}], "security_groups": [{"name": "tempest-securitygroup--1746854993"}], "key_name": "tempest-keypair-1687585322", "user_data": "}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:00.550151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:00.550655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:00.551539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:00.552080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:00.552574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:00.690977 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] validate_networks() for [('87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:17:00.780442 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:00.788685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-200be0dc-a49b-43cf-8bd2-3c34c3aba855 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1756 microversion: 2.1 time: 0.251023 Oct 10 17:17:00.789322 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 428/843] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:00 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:00.929577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:00.930189 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:00.936460 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:00.936948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:00.942081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:00.942081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:00.942081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:00.942081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.270407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:01.278051 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c69f9766-1f86-4f96-9ecd-994b56a30544 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.353659 Oct 10 17:17:01.278620 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 429/844] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:00 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:01.357356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:17:01.357833 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:17:01.358244 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:17:01.358655 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:17:01.359067 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:17:01.368318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:01.368800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:01.369240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.369968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:01.370425 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:01.370856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.388152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:17:01.391915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:17:01.403691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:17:01.406028 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:17:01.515864 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-519ef2c5-be1e-4ae8-a081-97c24e688b24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.970402 Oct 10 17:17:01.516539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 416/845] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:17:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 17:17:01.528509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2d4c62d9-785a-46d4-8900-7d00117bebef tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:01.529104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2d4c62d9-785a-46d4-8900-7d00117bebef tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:01.612770 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2d4c62d9-785a-46d4-8900-7d00117bebef tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:01.619874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2d4c62d9-785a-46d4-8900-7d00117bebef tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1242 microversion: 2.1 time: 0.095292 Oct 10 17:17:01.620571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 430/846] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:01 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:01.813086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:01.813859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:01.821197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:01.821687 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:01.822121 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.822817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:01.823267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:01.824100 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.928592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d0e7d5-ed20-4228-9ff6-536a37147fa4", "tag": "cc8b3043-6cec-450b-a20e-6ee72f3243ac"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:01.936117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:01.936676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:01.944832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:01.951137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:01.957997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] Creating event network-changed:cc8b3043-6cec-450b-a20e-6ee72f3243ac for instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 on hv-cinder-83454 Oct 10 17:17:01.963550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-3e7e4eb1-a8ac-4f38-9bc4-6048dcfeb213 req-c2064b58-d1e1-43ee-b926-5ed79b30ef05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043248 Oct 10 17:17:01.968360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 431/847] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:17:02.039091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:02.047547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-46baa60e-b180-4441-afb4-8b2f5f194ab2 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1759 microversion: 2.1 time: 0.238483 Oct 10 17:17:02.055742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 417/848] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:01 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1759 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:02.302030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:02.302731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:02.310330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:02.310815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:02.311249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:02.311935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:02.312408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:02.312831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:02.531079 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:02.539186 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ad1decb7-f610-4687-b7d6-0773ad3f1117 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.241491 Oct 10 17:17:02.539779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 432/849] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:02 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:02.643114 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:02.643821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:02.650036 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:02.650526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:02.651015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:02.651716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:02.652210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:02.652633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:02.756208 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:02.763961 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-16ad0c1d-9174-46cc-9399-bfa1b619ca30 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1246 microversion: 2.1 time: 0.124974 Oct 10 17:17:02.764562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 418/850] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:02 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:03.562875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:03.563481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:03.570363 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:03.570837 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:03.571269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:03.571948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:03.572419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:03.572839 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:03.699454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:03.706913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fc310f3b-fc82-4742-a410-5da0690c2b54 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.147980 Oct 10 17:17:03.707464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 433/851] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:03 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:03.786046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:03.786652 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:03.793081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:03.793561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:03.793995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:03.794679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:03.795129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:03.795551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:03.858463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:03.866647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a747aae4-9514-459a-a07c-dfcf58ef9b18 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1238 microversion: 2.1 time: 0.084363 Oct 10 17:17:03.867402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 419/852] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:03 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:04.733730 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:04.734456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:04.740882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:04.741370 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:04.741803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:04.742486 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:04.742934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:04.743354 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:04.870973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:04.878600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a6549e51-fb51-4915-8ea5-5a4e4389e534 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.148810 Oct 10 17:17:04.879154 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 434/853] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:04 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:04.890360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:04.891030 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:04.898420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:04.898925 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:04.899351 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:04.900072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:04.900526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:04.900951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:04.962753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:04.970550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ee753e58-6411-42c6-9471-5057cef9bb75 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1294 microversion: 2.1 time: 0.084173 Oct 10 17:17:04.971123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 420/854] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:04 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:05.902062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:05.902658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:05.909432 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:05.909920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:05.918987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:05.918987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:05.918987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:05.918987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:05.993658 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:05.994471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:06.000887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:06.001474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:06.002129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:06.002900 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:06.003553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:06.004304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:06.451734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:06.459505 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9917d917-36b9-4f18-9233-eec1933007d8 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.562110 Oct 10 17:17:06.460696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 435/855] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:05 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:06.495133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:06.502983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5275b7d4-4e4e-4392-b3ed-00adb8e7e714 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.513328 Oct 10 17:17:06.503545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 421/856] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:05 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:07.102074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c3b1c7-1726-4fa0-81c8-a7d2892c895b", "tag": "00f60993-555c-4b9e-b255-b47e508fa753"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:07.112599 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.113080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.113509 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.125063 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] Creating event network-changed:00f60993-555c-4b9e-b255-b47e508fa753 for instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b on hv-cinder-83454 Oct 10 17:17:07.129749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-f74317ba-b27d-45e9-9aab-4369cc989df8 req-1bb94635-cfc0-4549-9dc0-23229ba9f26a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 Oct 10 17:17:07.130295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 436/857] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:07.483157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:07.483701 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:07.491656 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.492436 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.492866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.493760 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.494200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.494822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.531613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:07.532622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:07.540657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.541392 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.542064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.543013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.543544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.544088 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.792527 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:07.800198 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-eb6111df-5e8a-486a-82ef-7acf7c4b3e17 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.321020 Oct 10 17:17:07.800773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 422/858] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:07 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:07.805161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0e7d5-ed20-4228-9ff6-536a37147fa4", "name": "network-vif-plugged", "status": "completed", "tag": "cc8b3043-6cec-450b-a20e-6ee72f3243ac"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:07.814433 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:07.814920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:07.815352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:07.828842 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] Creating event network-vif-plugged:cc8b3043-6cec-450b-a20e-6ee72f3243ac for instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 on hv-cinder-83454 Oct 10 17:17:07.833891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-0d12e454-0bbd-4088-ab16-b7da55b324b0 req-af4fd473-53d7-4676-8232-0aefee13ffd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Oct 10 17:17:07.834482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 423/859] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:07.840220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:07.847896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4bf600d5-d706-49dd-a089-130272960843 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.322037 Oct 10 17:17:07.848476 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 437/860] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:07 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:08.824797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:08.825421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:08.831432 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:08.831907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:08.832368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:08.833046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:08.833489 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:08.833906 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:08.871120 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:08.871729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:08.877995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:08.878482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:08.878917 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:08.879616 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:08.880089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:08.880513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:09.011463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:09.019187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3c3ea974-7838-41de-aeba-732d5a63dc0e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.199877 Oct 10 17:17:09.022675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 424/861] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:08 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:09.037866 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:09.045430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ef6afaa6-9394-4775-bc3f-810691593d6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.178163 Oct 10 17:17:09.045981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 438/862] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:08 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:10.041821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:10.042477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:10.048911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:10.053395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:10.053395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:10.053395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:10.053395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:10.053783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:10.068304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:10.068898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:10.076385 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:10.076899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:10.077330 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:10.078019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:10.078465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:10.078883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:10.244423 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:10.253255 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0ba9bbe5-b1d4-4d58-beb4-e067a30e92e7 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1319 microversion: 2.1 time: 0.214405 Oct 10 17:17:10.253927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 425/863] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:10 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:10.254779 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:10.262899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4a1b350c-a459-4656-9a48-21a7c253806f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.198629 Oct 10 17:17:10.263444 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 439/864] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:10 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:11.276867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:11.277474 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:11.283951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.284475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.284907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:11.285600 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.285702 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:11.286118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.286224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:11.286456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:11.292604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.293075 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.293502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:11.294184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.294629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.295044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:11.378779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=4 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:11.398417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=12 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:11.477473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:11.481857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:11.485291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7ffa003e-e824-4bf5-b508-5ed503d365b4 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1507 microversion: 2.1 time: 0.212424 Oct 10 17:17:11.485975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 426/865] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:11 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:11.493143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e151ccce-a9f5-4889-ad4e-9006de878136 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.208652 Oct 10 17:17:11.493143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 440/866] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:11 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:11.509348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49df4dd6-2683-4877-92f7-9c71b0278bda", "device": "/dev/sdb"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:11.511713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:11.517540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.518019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.518448 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:11.519128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:11.519573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:11.519991 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:12.243027 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2e46974e-f824-4eef-af34-49920b52b742 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "POST /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737391 Oct 10 17:17:12.243661 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 427/867] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:17:11 2022] POST /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:17:12.514121 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:12.515264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:12.517191 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=8 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:12.523173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:12.530777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:12.530777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:12.530777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:12.530777 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:12.531155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:12.657546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:12.665007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cadfe410-77b9-410b-bcf6-064ad52430a1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.154716 Oct 10 17:17:12.665555 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 441/868] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:12 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:13.626463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c3b1c7-1726-4fa0-81c8-a7d2892c895b", "name": "network-vif-plugged", "status": "completed", "tag": "00f60993-555c-4b9e-b255-b47e508fa753"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:13.637122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:13.637594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:13.638017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:13.649174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] Creating event network-vif-plugged:00f60993-555c-4b9e-b255-b47e508fa753 for instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b on hv-cinder-83454 Oct 10 17:17:13.654210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-629ba137-93d9-4588-9adc-1fbfc2f004cb req-8e7288c1-374c-4fb9-927e-31512df31f54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Oct 10 17:17:13.654846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 428/869] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:13.688467 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:13.689043 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:13.691318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:13.696754 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:13.697241 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:13.697683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:13.698366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:13.699074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:13.699533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:13.831897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:13.839618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c10cc5c5-f5c9-4cec-bf34-f3aa0ca4888f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.155186 Oct 10 17:17:13.840208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 442/870] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:13 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:14.863402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:14.864124 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:14.870868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:14.871534 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:14.871975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:14.872682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:14.873126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:14.873547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:14.999939 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:15.002503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:15.008523 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-beaed1fc-23b9-4003-9e0a-bfcdf97aa644 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1368 microversion: 2.1 time: 0.149485 Oct 10 17:17:15.011278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 429/871] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:14 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:16.032440 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:16.032997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:16.039927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:16.040470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:16.040908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:16.041604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:16.042052 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:16.042470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:16.172176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:16.180617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-360458c0-6574-46c8-8230-96a10233cce6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1558 microversion: 2.1 time: 0.152420 Oct 10 17:17:16.181175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 443/872] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:16 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:16.202730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:16.203243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:16.210205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:16.210680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:16.211110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:16.211789 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:16.212258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:16.215444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:16.290882 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a94a22cb-0cba-4857-b441-09fef9b624c9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092193 Oct 10 17:17:16.291473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 430/873] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:17:16 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:17.254046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c3b1c7-1726-4fa0-81c8-a7d2892c895b", "tag": "00f60993-555c-4b9e-b255-b47e508fa753"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:17.264676 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:17.265232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:17.265759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:17.276593 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] Creating event network-changed:00f60993-555c-4b9e-b255-b47e508fa753 for instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b on hv-cinder-83454 Oct 10 17:17:17.281745 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-ced798d8-e94d-47f4-b411-befbb80d5add req-13893734-c8d6-4a77-a2fb-9560fd4af746 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031654 Oct 10 17:17:17.282490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 444/874] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:33.319259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:17:33.319705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4/os-volume_attachments/49df4dd6-2683-4877-92f7-9c71b0278bda (ip 10.222.0.42) !!! Oct 10 17:17:33.321389 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:33.322783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=5 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:33.326799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:33.327281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:33.335157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:33.335639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:33.336089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:33.336775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:33.337220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:33.338224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:33.419598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lazy-loading 'services' on Instance uuid 65d0e7d5-ed20-4228-9ff6-536a37147fa4 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:17:33.631728 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d3528b55-f977-4436-9167-5ce778774837 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4/os-volume_attachments/49df4dd6-2683-4877-92f7-9c71b0278bda" status: 202 len: 0 microversion: 2.1 time: 0.313718 Oct 10 17:17:33.632268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 431/875] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:17:33 2022] DELETE /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4/os-volume_attachments/49df4dd6-2683-4877-92f7-9c71b0278bda => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:17:35.805724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=5 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:35.806554 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=71 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:17:35.810577 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:35.811152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:35.817042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:35.817601 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:35.817951 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:35.818632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:35.819076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:35.819493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:35.844538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:17:36.113697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-371f0b59-6857-4a99-86d3-11759e2e75ca tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 204 len: 0 microversion: 2.1 time: 0.309386 Oct 10 17:17:36.114206 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 445/876] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:17:35 2022] DELETE /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:17:36.125254 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:36.125944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:36.132048 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:36.132539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:36.132969 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:36.133671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:36.134168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:36.134591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:36.264134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:36.271654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-40809ad5-a1d8-4fd1-ab8f-47043c1d1409 tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1513 microversion: 2.1 time: 0.151235 Oct 10 17:17:36.272232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 432/877] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:36 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:37.296057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:37.297009 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:37.304785 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:37.305261 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:37.305713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:37.307141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:37.307791 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:37.308309 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:37.444078 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:37.452621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5810156d-acef-45be-ae2b-2f24dd1c096e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1513 microversion: 2.1 time: 0.161182 Oct 10 17:17:37.453219 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 446/878] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:37 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:38.475885 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:38.476544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:38.482992 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:38.483477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:38.483919 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:38.484642 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:38.485091 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:38.485513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:38.663550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:38.671515 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9fcf32a0-19b3-478b-bd01-f0a8c0f0696b tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1513 microversion: 2.1 time: 0.199456 Oct 10 17:17:38.672144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 433/879] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:38 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:38.794057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0e7d5-ed20-4228-9ff6-536a37147fa4", "name": "network-vif-deleted", "tag": "cc8b3043-6cec-450b-a20e-6ee72f3243ac"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:38.803935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:38.804450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:38.804883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:38.816125 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] Creating event network-vif-deleted:cc8b3043-6cec-450b-a20e-6ee72f3243ac for instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 on hv-cinder-83454 Oct 10 17:17:38.820980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-ecc318b6-2d6c-4c87-b174-849a39f5fafd req-76de3083-fed2-4b0a-a57f-8b8cf444c39d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Oct 10 17:17:38.822883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 447/880] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:39.694723 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:39.695377 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:39.703147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:39.703854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:39.704403 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:39.705107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:39.705733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:39.706162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:39.739853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:39.740372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:39.740815 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:39.741262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lazy-loading 'fault' on Instance uuid 65d0e7d5-ed20-4228-9ff6-536a37147fa4 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:17:39.789089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a800d4a53c234d2fa53eeb0c68163f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9422ce68e164e7d8ae8dbf168e58e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:39.799007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6e91d54e-8b82-4c44-afea-72f7c71940bd tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 200 len: 1309 microversion: 2.1 time: 0.108136 Oct 10 17:17:39.799595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 434/881] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:39 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:40.824002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:40.824973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] [instance: 65d0e7d5-ed20-4228-9ff6-536a37147fa4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:40.831494 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:40.831908 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:40.832450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:40.833126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:40.833570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:40.833989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:40.847232 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] HTTP exception thrown: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Request method failure captured: Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 HTTP/1.1 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqpSO6OfRu4UnZHNu2NqhVMYPGFMARo__egBMy--lVsijcnUhHqRiFXbyE0khcDf49xN0kucGRGRH40v8SEXs5hn50Bwr5F_-ZLPtZ1BGbWP7SCLLseaXq3djy4an0IRbRaOimNjXqtbQlT0XDa9Uo4ya_P-DF_jEqqKOWOx1veQM Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: b9422ce68e164e7d8ae8dbf168e58e78 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:17:40.848864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9422ce68e164e7d8ae8dbf168e58e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9422ce68e164e7d8ae8dbf168e58e78"}]}] Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: b9422ce68e164e7d8ae8dbf168e58e78 Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1198335059 Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesSnapshotTestJSON-1198335059-project Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: a800d4a53c234d2fa53eeb0c68163f44 Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesSnapshotTestJSON-1198335059-project Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. Oct 10 17:17:40.850507 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '65d0e7d5-ed20-4228-9ff6-536a37147fa4'} Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:17:40.851438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. Oct 10 17:17:40.852993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:40.854329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] Returning 404 to user: Instance 65d0e7d5-ed20-4228-9ff6-536a37147fa4 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:17:40.854329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-73a16f52-a5de-4518-8d05-f13ce8c34c7e tempest-VolumesSnapshotTestJSON-1198335059 tempest-VolumesSnapshotTestJSON-1198335059-project] 10.222.0.42 "GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4" status: 404 len: 111 microversion: 2.1 time: 0.030925 Oct 10 17:17:40.854329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 448/882] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:40 2022] GET /compute/v2.1/servers/65d0e7d5-ed20-4228-9ff6-536a37147fa4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:17:46.334729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1292890992"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:46.335341 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:46.342431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:46.342915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:46.343350 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:46.344064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:46.344520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:46.344941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:46.472077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.network.security_group_api [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Removing security group eb31bbfb-c53e-4db8-a4ad-3089329857db from port b6c7057f-178b-49ef-a993-8f7df4dcbcbf Oct 10 17:17:46.835316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-71983740-1cb5-4aa0-8b08-86d952b7af50 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action" status: 202 len: 0 microversion: 2.1 time: 0.504421 Oct 10 17:17:46.835928 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 435/883] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:17:46 2022] POST /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:17:46.844942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:46.855465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:46.855943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:46.856402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:46.874586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] Creating event network-changed:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:17:46.880761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-ea2e399e-1733-494b-818e-2a366ddcfb81 req-c4b8a7b5-5a5a-48b4-8ce6-1fcdf08cc741 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039872 Oct 10 17:17:46.881677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 449/884] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:17:48.306282 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:48.306867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:48.312917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:48.313404 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:48.313836 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:48.314521 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:48.314971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:48.315390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:48.398869 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lazy-loading 'services' on Instance uuid 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:17:48.621064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-af84a7e2-4362-488a-a2ad-72addb45d982 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments/03c93647-37e7-4e9c-beb0-ca8e20227e61" status: 202 len: 0 microversion: 2.1 time: 0.319088 Oct 10 17:17:48.626125 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 436/885] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:17:48 2022] DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments/03c93647-37e7-4e9c-beb0-ca8e20227e61 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:17:48.631375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:48.633953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:48.641335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:48.642874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:48.643434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:48.644146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:48.644607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:48.645033 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:48.674463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b8854642-1f0b-4b80-ad6a-7ed986b15527 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048147 Oct 10 17:17:48.675024 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 450/886] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:17:48 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:48.897504 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:48.907128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:48.907578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:48.908004 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:48.921215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] Creating event network-changed:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:17:48.926052 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-d9d71205-a073-4ead-a74d-2b456d0153c3 req-47e4ef2c-704d-4a75-9941-4329025ddb54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Oct 10 17:17:48.926635 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 437/887] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:17:49.687578 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:49.689834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:49.696115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:49.696600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:49.697032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:49.697722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:49.698686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:49.699108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:49.728650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d82276ab-4e24-4da2-82bf-c49b2ae09473 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Oct 10 17:17:49.729247 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 451/888] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:17:49 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:50.742995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:50.746010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:50.752765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:50.753434 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:50.753890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:50.754570 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:50.755014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:50.755455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:50.784333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-72cb0f3a-5435-41db-a3a4-8a4611c40c92 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047503 Oct 10 17:17:50.784925 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 438/889] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:17:50 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:17:50.796035 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:50.796561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:50.802492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:50.802974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:50.803403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:50.804111 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:50.804561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:50.804981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:50.878886 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] HTTP exception thrown: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 is not attached to volume 03c93647-37e7-4e9c-beb0-ca8e20227e61 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Request method failure captured: Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments/03c93647-37e7-4e9c-beb0-ca8e20227e61 HTTP/1.1 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMS2bDWkJFteQak6saINXQ8OhRX2O3flPBx7BT53f7MDaJIu1zqcDIsIp3Kuqtpo_ElExYcCLVJaCa8Xr8007MgopwO1jwCDqRgcUHgSWhcToWJyDoLJ2HpGJHmaIxry-EWIBRYuq_eYVqI5IZncDLOjtIvJvx1o0Thod16kzsmhfc Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 4f9731af8c4c4188bc61c7f35b8bdc5e Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:17:50.881340 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4f9731af8c4c4188bc61c7f35b8bdc5e"}]}] Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 4f9731af8c4c4188bc61c7f35b8bdc5e Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-TestMinimumBasicScenario-502338644-project Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: e750af16ce0d4742a3305141470ff308 Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-TestMinimumBasicScenario-502338644-project Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:17:50.883208 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 is not attached to volume 03c93647-37e7-4e9c-beb0-ca8e20227e61 Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'server_id': '722e1595-92ab-4b45-a8c6-a31bfe3e2f09', 'id': '03c93647-37e7-4e9c-beb0-ca8e20227e61'} Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 03c93647-37e7-4e9c-beb0-ca8e20227e61. Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:17:50.884259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 is not attached to volume 03c93647-37e7-4e9c-beb0-ca8e20227e61 Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 is not attached to volume 03c93647-37e7-4e9c-beb0-ca8e20227e61 Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:17:50.885749 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Returning 404 to user: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 is not attached to volume 03c93647-37e7-4e9c-beb0-ca8e20227e61 {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:17:50.886849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1fef4031-7a1f-45f3-92d5-9c2c4f4692a6 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments/03c93647-37e7-4e9c-beb0-ca8e20227e61" status: 404 len: 154 microversion: 2.1 time: 0.091280 Oct 10 17:17:50.886849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 452/890] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:17:50 2022] DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09/os-volume_attachments/03c93647-37e7-4e9c-beb0-ca8e20227e61 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:17:52.155989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:52.156507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:52.162947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:52.163455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:52.167809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:52.167809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:52.167809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:52.167809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:52.190892 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:17:52.473887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bdbd1640-3351-494c-93b7-aa6fbd7ea5b4 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 204 len: 0 microversion: 2.1 time: 0.321473 Oct 10 17:17:52.474477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 439/891] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:17:52 2022] DELETE /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:17:52.483173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:52.483778 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:52.490447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:52.490927 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:52.491360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:52.492064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:52.492511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:52.492946 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:52.620532 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:52.628018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9d505fcb-7c8c-4b71-bf6a-6f3a3c88fede tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1554 microversion: 2.1 time: 0.149000 Oct 10 17:17:52.628597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 453/892] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:52 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:17:53.652379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:53.653070 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:53.659393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:53.659866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:53.660330 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:53.661010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:53.661454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:53.661872 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:53.787333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:53.794980 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0549fe40-bd88-4edc-bb9b-adf26843610e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1554 microversion: 2.1 time: 0.147605 Oct 10 17:17:53.795540 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 440/893] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:53 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:54.818907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:54.819600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:54.826378 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:54.826861 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:54.827295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:54.827988 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:54.828454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:54.828873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:54.958776 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:54.966377 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-695f49cb-50d6-4c83-8007-dbdb83e7952e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1554 microversion: 2.1 time: 0.151578 Oct 10 17:17:54.966928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 454/894] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:54 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:55.990154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:55.990803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:55.997988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:55.998516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:55.998957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:55.999651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:56.000133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:56.004259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:56.127816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:56.135716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-867c8a9e-9fa4-4c5e-ac0c-f1590bf44c0e tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1554 microversion: 2.1 time: 0.149430 Oct 10 17:17:56.136294 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 441/895] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:55 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:57.159512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:57.160145 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:57.167222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:57.167707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:57.168175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:57.168987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:57.169430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:57.169852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:57.298490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:57.306077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-de91ad75-ff9c-4bc4-b10b-bf9798385e89 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1554 microversion: 2.1 time: 0.150567 Oct 10 17:17:57.306671 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 455/896] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:57 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:57.867530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e1595-92ab-4b45-a8c6-a31bfe3e2f09", "name": "network-vif-deleted", "tag": "b6c7057f-178b-49ef-a993-8f7df4dcbcbf"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:17:57.877358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:57.878355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:57.878355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:57.890210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] Creating event network-vif-deleted:b6c7057f-178b-49ef-a993-8f7df4dcbcbf for instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 on hv-cinder-83454 Oct 10 17:17:57.895443 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-70088391-e722-4c70-81d0-149b18555b87 req-d8c0d07e-b323-47f0-a5fb-850838179c4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Oct 10 17:17:57.896088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 442/897] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:17:58.330032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:58.330807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:58.336971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:58.337445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:58.337882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:58.338932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:58.339558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:58.339978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:58.372839 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:58.373312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:58.373740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:58.374179 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lazy-loading 'fault' on Instance uuid 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:17:58.418345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e750af16ce0d4742a3305141470ff308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9731af8c4c4188bc61c7f35b8bdc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:17:58.426320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e39652a6-3870-4ee4-96f8-51afd2f7b3d0 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 200 len: 1349 microversion: 2.1 time: 0.100021 Oct 10 17:17:58.426872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 456/898] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:58 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:17:59.451210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:59.452012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] [instance: 722e1595-92ab-4b45-a8c6-a31bfe3e2f09] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:17:59.458472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:59.458975 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:59.459408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:59.460182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:17:59.460636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:17:59.461059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:17:59.474958 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] HTTP exception thrown: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Request method failure captured: Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 HTTP/1.1 Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMS2bDWkJFteQak6saINXQ8OhRX2O3flPBx7BT53f7MDaJIu1zqcDIsIp3Kuqtpo_ElExYcCLVJaCa8Xr8007MgopwO1jwCDqRgcUHgSWhcToWJyDoLJ2HpGJHmaIxry-EWIBRYuq_eYVqI5IZncDLOjtIvJvx1o0Thod16kzsmhfc Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: 4f9731af8c4c4188bc61c7f35b8bdc5e Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:17:59.476630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4f9731af8c4c4188bc61c7f35b8bdc5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4f9731af8c4c4188bc61c7f35b8bdc5e"}]}] Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: 4f9731af8c4c4188bc61c7f35b8bdc5e Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-TestMinimumBasicScenario-502338644 Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-TestMinimumBasicScenario-502338644-project Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: e750af16ce0d4742a3305141470ff308 Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-TestMinimumBasicScenario-502338644-project Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. Oct 10 17:17:59.478231 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '722e1595-92ab-4b45-a8c6-a31bfe3e2f09'} Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:17:59.479266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. Oct 10 17:17:59.480878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:17:59.482295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Returning 404 to user: Instance 722e1595-92ab-4b45-a8c6-a31bfe3e2f09 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:17:59.482295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0e97f870-d303-4041-b193-c23f625bdb52 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09" status: 404 len: 111 microversion: 2.1 time: 0.032506 Oct 10 17:17:59.482295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 443/899] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:17:59 2022] GET /compute/v2.1/servers/722e1595-92ab-4b45-a8c6-a31bfe3e2f09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:17:59.486760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c4a9ca8c-28ff-4ecc-beef-dcb42c822640 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] Calling method '.version_select at 0x7f34ef7c2b80>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:17:59.563922 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c4a9ca8c-28ff-4ecc-beef-dcb42c822640 tempest-TestMinimumBasicScenario-502338644 tempest-TestMinimumBasicScenario-502338644-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1522106937" status: 202 len: 0 microversion: 2.1 time: 0.081010 Oct 10 17:17:59.564498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 457/900] 10.222.0.42 () {58 vars in 1272 bytes} [Mon Oct 10 17:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1522106937 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:18:12.702823 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:12.703378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:12.705654 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:12.706290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:12.710942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:12.711421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:12.711856 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:12.712568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:12.713020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:12.714007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:12.737680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-befd104c-97f9-45ef-bde8-b0709b1ca4b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/ips" status: 200 len: 149 microversion: 2.1 time: 0.039095 Oct 10 17:18:12.738240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 444/901] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:18:12 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:12.747286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:12.748108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:12.752129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:12.754429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:12.761066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:12.761549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:12.761983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:12.762669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:12.763143 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:12.763568 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:13.016163 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: POST /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/os-volume_attachments HTTP/1.1 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 74 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:18:13.017818 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {"volumeAttachment": {"volumeId": "c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c"}} Oct 10 17:18:13.019471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'server_id': 'b3c3b1c7-1726-4fa0-81c8-a7d2892c895b', 'body': {'volumeAttachment': {'volumeId': 'c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c'}}} Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:13.020638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:13.021859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 400 to user: Invalid volume: volume c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c is already attached to instances: 622151bc-b582-4981-a615-3839765b0b75 {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-792f7d4f-c5c7-48e1-aebc-fb8b31ae44a0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.273378 Oct 10 17:18:13.023117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 458/902] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:18:12 2022] POST /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 17:18:13.030416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:13.031352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:13.038174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:13.038660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:13.039147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:13.039786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:13.040262 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:13.042949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:13.065023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:18:13.376506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b42d3555-751c-4b11-8e8f-3babb8761d3e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 204 len: 0 microversion: 2.1 time: 0.350823 Oct 10 17:18:13.377105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 445/903] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:18:13 2022] DELETE /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:18:13.385999 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:13.386692 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:13.392732 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:13.396160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:13.396160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:13.396160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:13.396160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:13.396536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:13.524854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:13.532596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f9e48397-4523-4b55-8a55-b7c17182d2b8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.151180 Oct 10 17:18:13.536758 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 459/904] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:13 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:18:14.556378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:14.557074 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:14.567617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:14.568138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:14.568579 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:14.569283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:14.569733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:14.570159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:14.793034 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:14.800627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2d76ca21-e72a-4d2e-9aa2-989a7e9a6056 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.248500 Oct 10 17:18:14.801185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 446/905] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:14 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:15.825405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:15.826034 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:15.832316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:15.832790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:15.833212 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:15.833887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:15.834333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:15.834756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:15.961466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:15.970504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0a0a6692-26c6-41cb-a389-e7561aeec18f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.149905 Oct 10 17:18:15.974592 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 460/906] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:15 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:16.993617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:16.994228 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:17.001506 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:17.001990 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:17.002420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:17.003107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:17.003554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:17.003972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:17.131210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:17.138851 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6919cae8-8463-4cc2-a6ab-2364161052dc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.149138 Oct 10 17:18:17.139410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 447/907] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:16 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:18.162641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:18.163159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:18.170017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:18.170491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:18.170919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:18.171594 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:18.172050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:18.172478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:18.298891 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:18.306423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f303d349-8cce-48cc-a337-005aa3f798c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.147782 Oct 10 17:18:18.307017 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 461/908] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:18 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:19.330084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:19.330695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:19.337006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:19.337482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:19.337910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:19.338667 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:19.339111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:19.339529 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:19.468890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:19.476550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6f10a30a-ee58-4102-9be3-a5bcab9b9c9e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1682 microversion: 2.1 time: 0.150364 Oct 10 17:18:19.477105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 448/909] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:19 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:19.906280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c3b1c7-1726-4fa0-81c8-a7d2892c895b", "name": "network-vif-unplugged", "status": "completed", "tag": "00f60993-555c-4b9e-b255-b47e508fa753"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:19.918180 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:19.918726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:19.919240 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:19.930198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] Creating event network-vif-unplugged:00f60993-555c-4b9e-b255-b47e508fa753 for instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b on hv-cinder-83454 Oct 10 17:18:19.935801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-7f18ddd7-e57b-4c29-a239-ed32fd8e1ed2 req-7b93ce26-a018-4806-9d33-9e04fa3b6b5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033779 Oct 10 17:18:19.936513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 462/910] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:20.502923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:20.503858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:20.511318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:20.512090 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:20.512676 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:20.513691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:20.514142 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:20.514678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:20.835283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:20.846081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ce0b6d9a-f518-403a-ada0-81505848aaf3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1614 microversion: 2.1 time: 0.349366 Oct 10 17:18:20.847812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 449/911] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:20 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1614 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:20.943246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c3b1c7-1726-4fa0-81c8-a7d2892c895b", "name": "network-vif-deleted", "tag": "00f60993-555c-4b9e-b255-b47e508fa753"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:20.954738 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:20.955485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:20.956207 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:20.972642 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] Creating event network-vif-deleted:00f60993-555c-4b9e-b255-b47e508fa753 for instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b on hv-cinder-83454 Oct 10 17:18:20.978010 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-9ed52f06-d893-41de-ae06-0cf3fd86a5ab req-10c5c68e-51e1-4974-b87b-d18af329f0e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045860 Oct 10 17:18:20.979387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 463/912] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:21.872536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:21.873268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:21.879878 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:21.880470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:21.881000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:21.881777 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:21.882305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:21.882738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:21.914460 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:21.914942 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:21.915373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:21.915813 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid b3c3b1c7-1726-4fa0-81c8-a7d2892c895b {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:21.956444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:21.964907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bc9b8d04-7aa8-4d84-ac74-8175a5bd0ecc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1332 microversion: 2.1 time: 0.096263 Oct 10 17:18:21.965477 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 450/913] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:21 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:22.989195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:22.989885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:22.996628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:22.997105 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:22.997533 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:22.998209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:22.998705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:22.999117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:23.031392 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:23.031868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:23.032327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:23.032766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid b3c3b1c7-1726-4fa0-81c8-a7d2892c895b {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:23.072464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:23.080238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-e52d6a74-38d7-410f-9602-cf83037e0c00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1332 microversion: 2.1 time: 0.096116 Oct 10 17:18:23.080796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 464/914] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:22 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:24.102729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:24.103333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:24.110329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:24.110806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:24.111236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:24.111914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:24.112386 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:24.112808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:24.145281 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:24.145682 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:24.146109 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:24.146544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid b3c3b1c7-1726-4fa0-81c8-a7d2892c895b {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:24.186248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:24.193741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a0594e5c-ec48-448f-8586-cebab398ba59 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 200 len: 1332 microversion: 2.1 time: 0.094879 Oct 10 17:18:24.194297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 451/915] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:24 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:25.217286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:25.217894 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:25.223735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:25.224251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:25.224694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:25.225412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:25.225892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:25.226312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:25.239456 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b HTTP/1.1 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:18:25.241117 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:18:25.242550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'b3c3b1c7-1726-4fa0-81c8-a7d2892c895b'} Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:25.243371 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:18:25.246982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:25.248883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:25.248883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d97c3f41-bfef-430f-afde-f9ba02c9e9b7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 404 len: 111 microversion: 2.1 time: 0.029874 Oct 10 17:18:25.248883 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 465/916] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:25 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:25.251719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-322ec8f5-caff-4a04-9a79-4af2ae14ea6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '.version_select at 0x7f34ef4a1820>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:25.324802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-322ec8f5-caff-4a04-9a79-4af2ae14ea6e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687585322" status: 202 len: 0 microversion: 2.1 time: 0.076250 Oct 10 17:18:25.325587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 452/917] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 10 17:18:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687585322 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:18:26.161896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:26.162389 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:26.168341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:26.168816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:26.169240 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:26.169914 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:26.170358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:26.170978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:26.250089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'services' on Instance uuid 622151bc-b582-4981-a615-3839765b0b75 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:26.478889 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d1a14a15-bae6-4a2b-b859-470eedc37201 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments/c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c" status: 202 len: 0 microversion: 2.1 time: 0.320843 Oct 10 17:18:26.479544 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 466/918] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:18:26 2022] DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments/c1e6eec3-fe7f-46b2-9ce7-ff40de50e88c => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:18:26.489274 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:26.491388 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:26.498755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:26.499232 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:26.499663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:26.500420 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:26.500868 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:26.501285 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:26.530187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fd80ef06-41ac-472e-96bd-20183c4dd417 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Oct 10 17:18:26.530737 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 453/919] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:18:26 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:27.543622 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:27.546148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:27.552697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:27.553237 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:27.553871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:27.554558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:27.555053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:27.555684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:27.587315 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-54a2e6d5-956f-47f6-a8f2-50b682daf397 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048522 Oct 10 17:18:27.588268 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 467/920] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:18:27 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:28.177358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:28.177966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:28.180853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbabe562-2556-478f-995a-56dc3e6309b4", "tag": "f141f1b5-a360-478a-9824-c75871e9cee8"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:28.186617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.187174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.187858 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.188552 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.188994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.189587 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.190974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.191774 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.192206 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.203913 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] Creating event network-changed:f141f1b5-a360-478a-9824-c75871e9cee8 for instance dbabe562-2556-478f-995a-56dc3e6309b4 on hv-cinder-83454 Oct 10 17:18:28.209631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-46edcc1c-cf1f-467a-a56b-096aa0a146cd req-6b833e24-a422-4e9a-a42a-18d3a144dfcc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031870 Oct 10 17:18:28.210293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 468/921] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:28.216677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:18:28.531017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bcb134b5-a202-4265-af38-7cff1e67097c tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 204 len: 0 microversion: 2.1 time: 0.357471 Oct 10 17:18:28.532407 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 454/922] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:18:28 2022] DELETE /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:18:28.541053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:28.542110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:28.549419 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.550756 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.551424 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.552393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.553060 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.553833 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.601268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:28.603619 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:28.610915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.611621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.612258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.613128 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.613739 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.614852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.649560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3b125500-899a-4dcb-b580-69854bd23f87 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053050 Oct 10 17:18:28.650146 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 455/923] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:18:28 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:18:28.706468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:28.716159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d3caa083-ab25-414f-9b8b-9422f54b84a9 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1578 microversion: 2.1 time: 0.177764 Oct 10 17:18:28.716159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 469/924] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:28 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:18:28.722993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:28.723492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:28.729550 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.730569 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.731010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.731895 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:28.732377 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:28.732801 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:28.759139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:18:28.793694 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:29.032072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-977109fd-40be-4bb5-b3a7-36da0958dfe9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 204 len: 0 microversion: 2.1 time: 0.312791 Oct 10 17:18:29.032775 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 456/925] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:18:28 2022] DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:18:29.041942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:29.041942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:29.048865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:29.049339 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:29.049769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:29.050465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:29.050909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:29.051327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:29.189854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:29.197813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cd68633a-3d6d-4c4b-81ef-395e6841f6f6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1683 microversion: 2.1 time: 0.160608 Oct 10 17:18:29.198376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 470/926] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:29 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:29.739112 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:29.739740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:29.746914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:29.747410 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:29.747844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:29.748573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:29.749025 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:29.749451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:29.887462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:29.895122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3d928092-e434-44d6-b698-b2edae3602bc tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1578 microversion: 2.1 time: 0.160680 Oct 10 17:18:29.895683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 457/927] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:29 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:30.221697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:30.222302 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:30.228918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:30.229411 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:30.232110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:30.232110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:30.232110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:30.232110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:30.360537 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:30.368326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-069b5f1d-7cb3-4a08-948e-c09137166276 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1683 microversion: 2.1 time: 0.150444 Oct 10 17:18:30.368887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 471/928] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:30 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:30.918152 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:30.918760 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:30.925185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:30.925672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:30.926111 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:30.926803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:30.927258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:30.927685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:31.060267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:31.067962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-86a42dac-1bcb-46e0-b6a8-af1a6d864f10 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1578 microversion: 2.1 time: 0.153693 Oct 10 17:18:31.068560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 458/929] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:30 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:31.392768 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:31.393366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:31.399587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:31.400093 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:31.400523 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:31.401225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:31.401669 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:31.402085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:31.529056 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:31.536952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c6b206a1-244d-4230-b938-6990c7ef67c6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1683 microversion: 2.1 time: 0.147975 Oct 10 17:18:31.537724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 472/930] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:31 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:32.092950 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:32.093536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:32.100565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:32.101061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:32.101499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:32.102221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:32.102672 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:32.103095 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:32.240879 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:32.248699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e4ab8b52-7c7d-48ae-b9d1-35b19bb539b8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1460 microversion: 2.1 time: 0.160439 Oct 10 17:18:32.249266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 459/931] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:32 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:18:32.561153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:32.562408 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:32.568939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:32.569417 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:32.570062 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:32.570753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:32.571375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:32.571797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:32.781028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:32.788911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-24a99f3a-8485-483a-a182-c3dbbde97045 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1683 microversion: 2.1 time: 0.232446 Oct 10 17:18:32.800852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 473/932] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:32 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:32.966951 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbabe562-2556-478f-995a-56dc3e6309b4", "name": "network-vif-deleted", "tag": "f141f1b5-a360-478a-9824-c75871e9cee8"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:32.976320 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:32.976798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:32.977226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:32.987986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] Creating event network-vif-deleted:f141f1b5-a360-478a-9824-c75871e9cee8 for instance dbabe562-2556-478f-995a-56dc3e6309b4 on hv-cinder-83454 Oct 10 17:18:32.993165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-d63fd52e-08d2-4557-92cf-bd6ea5d94dbc req-bf24ea00-cea9-4f7b-a2e1-997447cdcd89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029909 Oct 10 17:18:32.993758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 460/933] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:33.215677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622151bc-b582-4981-a615-3839765b0b75", "name": "network-vif-deleted", "tag": "4d8540fa-63ed-42d6-8d51-362073b36af2"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:33.225796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.226527 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.226961 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.238639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] Creating event network-vif-deleted:4d8540fa-63ed-42d6-8d51-362073b36af2 for instance 622151bc-b582-4981-a615-3839765b0b75 on hv-cinder-83454 Oct 10 17:18:33.243516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-9ecb0e77-bc76-42ae-9600-a97220784676 req-ba5ae293-1056-43b2-9897-f91f3dd6dd50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Oct 10 17:18:33.244128 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 474/934] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:33.271923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:33.277137 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:33.295048 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.295830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.296454 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.297371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.297989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.298575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.367035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:33.376639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6466fddf-4b7a-4fa4-bfd7-6fe5a2f9e2ed tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1225 microversion: 2.1 time: 0.109419 Oct 10 17:18:33.388671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 461/935] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:33 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:33.813465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:33.814947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:33.820639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.821199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.821699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.822611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.823127 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.823629 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.855983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:33.856574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:33.857018 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:33.857679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid 622151bc-b582-4981-a615-3839765b0b75 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:33.903041 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:33.910890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c2f3026b-1a4c-47fd-b129-9a838489a823 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 200 len: 1332 microversion: 2.1 time: 0.102577 Oct 10 17:18:33.911452 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 475/936] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:33 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:34.403508 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:34.404224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:34.419221 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:34.419937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:34.422354 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:34.424677 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:34.425195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:34.425696 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:34.457688 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:34.458186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:34.458616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:34.459061 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lazy-loading 'fault' on Instance uuid dbabe562-2556-478f-995a-56dc3e6309b4 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:34.500753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:34.508761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-387ddf54-3fa8-4ffb-b9df-20899137b3dd tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 200 len: 1230 microversion: 2.1 time: 0.112757 Oct 10 17:18:34.509422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 462/937] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:34 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:34.935320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:34.935930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:34.943492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:34.944535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:34.944980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:34.945755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:34.946395 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:34.946828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:34.961727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 HTTP/1.1 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:18:34.963402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:18:34.965581 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '622151bc-b582-4981-a615-3839765b0b75'} Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:34.967185 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:18:34.971679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:34.973044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:34.973044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ca05d3d6-d15b-4628-b42b-fe43cdeb98da tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 404 len: 111 microversion: 2.1 time: 0.034761 Oct 10 17:18:34.973044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 476/938] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:34 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:34.976854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-343afc53-6af6-4d61-b0f3-d1b91418b48a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '.version_select at 0x7f34ef15a550>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:35.072755 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-343afc53-6af6-4d61-b0f3-d1b91418b48a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115731019" status: 202 len: 0 microversion: 2.1 time: 0.102256 Oct 10 17:18:35.073331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 463/939] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 10 17:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115731019 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:18:35.534726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:35.535343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: dbabe562-2556-478f-995a-56dc3e6309b4] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:35.541265 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:35.541753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:35.542193 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:35.542888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:35.543343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:35.543767 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:35.547816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:35.556944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] HTTP exception thrown: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Request method failure captured: Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 HTTP/1.1 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFH5uADiX5nDsoDfKzdmPVi77ARCYNb5tvC4h-JSTsa7t4HIGpfTr1KowbowTpflZ7tEGTBB-MG3H4g7FIMxydJppf-xYuGEQOs69WlUghAZ002-RLGxWgnCNqOBGlpT6kHmIkxcYuCBosag8R3yZYNFtmMAHPRec3UW5oaFnfxydIM Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:18:35.558477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0d86e93942189945656ccb70c059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0d86e93942189945656ccb70c059"}]}] Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: d625c099d9134f78b3e8940879c19106 Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. Oct 10 17:18:35.560450 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'dbabe562-2556-478f-995a-56dc3e6309b4'} Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:35.561216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. Oct 10 17:18:35.562449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:35.563531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Returning 404 to user: Instance dbabe562-2556-478f-995a-56dc3e6309b4 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:35.563531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bc257fe8-9566-4e8c-809b-df985a20f8f8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4" status: 404 len: 111 microversion: 2.1 time: 0.029061 Oct 10 17:18:35.563531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 477/940] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:35 2022] GET /compute/v2.1/servers/dbabe562-2556-478f-995a-56dc3e6309b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:35.801412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-385b0d14-6606-4aa3-b81e-613eace0a96d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: .version_select at 0x7f34ef46b3a0>, body: {"keypair": {"name": "tempest-keypair-1279973504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgX7JNpsJPIkdAUjEQDtBGSAPIOHrodgfM0+Emprq3l5Hh2/pdPan0Jz+DP7ysGw0+atZ6/Sb8tDg+gdn1hiddPM4g76dyaY5IdJciy1gjyxoeJ6uTjOlW7Y4UfiufffQ=="}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:35.822382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-385b0d14-6606-4aa3-b81e-613eace0a96d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:18:35.827201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-385b0d14-6606-4aa3-b81e-613eace0a96d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:18:35.907191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-385b0d14-6606-4aa3-b81e-613eace0a96d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110101 Oct 10 17:18:35.907800 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 464/941] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:18:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:38.159262 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2128224181", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0"}], "security_groups": [{"name": "tempest-securitygroup--1997907341"}], "key_name": "tempest-keypair-1279973504", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:38.266795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] validate_networks() for [('87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:18:38.654632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:18:38.655155 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:18:38.655713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:18:38.656220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:18:38.656697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:18:38.665536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:38.666066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:38.666500 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:38.667227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:38.667755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:38.668203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:38.684525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:18:38.688588 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:18:38.700198 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:18:38.702820 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:18:38.805719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [94b4aa60-251c-43d0-906d-786a617e7b04] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 17:18:38.898391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:38.898986 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:38.904996 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:38.905485 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:38.905925 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:38.906617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:38.907070 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:38.907494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:38.932295 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:18:39.371226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-85825869-235b-452a-9772-93e7b489f182 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 204 len: 0 microversion: 2.1 time: 0.477021 Oct 10 17:18:39.371863 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 465/942] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:18:38 2022] DELETE /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 17:18:39.377414 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c61c0c-5d47-44dd-8cb0-12f76cd4a681", "tag": "33e35059-afb9-405e-9e7a-7271d3f1cfce"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:39.387139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:39.387610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:39.388138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:39.401015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] Creating event network-changed:33e35059-afb9-405e-9e7a-7271d3f1cfce for instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 on hv-cinder-83454 Oct 10 17:18:39.406920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-005eb568-2b77-43dc-bc87-aa29e9cae3e2 req-587d9415-c7c9-48c0-bb63-687bd21fcd96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033752 Oct 10 17:18:39.407520 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 466/943] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:39.412413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:39.413101 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:39.419097 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:39.419580 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:39.420015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:39.420734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:39.421181 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:39.421602 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:39.560106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:39.567953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5124a682-6777-4b5b-a18f-1737fea7523f tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1577 microversion: 2.1 time: 0.159279 Oct 10 17:18:39.568554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 467/944] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:39 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:39.814477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO oslo.messaging._drivers.impl_rabbit [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [94b4aa60-251c-43d0-906d-786a617e7b04] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56256. Oct 10 17:18:39.818854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4a283eb5-b622-4060-9000-e708392b9167 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.664616 Oct 10 17:18:39.819658 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 478/945] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:18:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:18:39.835496 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-329511a0-02bf-4e50-8dc3-2ba1aea82aa6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:39.836135 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-329511a0-02bf-4e50-8dc3-2ba1aea82aa6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:39.890202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-329511a0-02bf-4e50-8dc3-2ba1aea82aa6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:39.897601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-329511a0-02bf-4e50-8dc3-2ba1aea82aa6 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1242 microversion: 2.1 time: 0.067492 Oct 10 17:18:39.898168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 468/946] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:39 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:40.593000 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:40.593743 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:40.599805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:40.600321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:40.600819 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:40.601504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:40.601955 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:40.602416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:40.737222 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:40.745331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2950d18b-4cb4-452c-a290-417735cd1f01 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1577 microversion: 2.1 time: 0.157313 Oct 10 17:18:40.746868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 479/947] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:40 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:40.920056 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:40.920773 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:40.928227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:40.928708 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:40.929137 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:40.929822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:40.930269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:40.930693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:40.990607 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:40.998902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8dac7acc-6ec7-45ed-97a4-aac1127aa5a9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1246 microversion: 2.1 time: 0.082672 Oct 10 17:18:40.999461 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 469/948] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:40 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:41.768623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:41.769190 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:41.775948 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:41.781746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:41.781746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:41.781746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:41.781746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:41.782152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:41.883430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:41.894205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3baf8e57-1f88-4aaf-af17-5237c3ff22d8 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1391 microversion: 2.1 time: 0.129587 Oct 10 17:18:41.895846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 480/949] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:41 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1391 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:41.896941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c61c0c-5d47-44dd-8cb0-12f76cd4a681", "name": "network-vif-deleted", "tag": "33e35059-afb9-405e-9e7a-7271d3f1cfce"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:41.904400 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:41.908411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:41.908880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:41.909303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:41.921453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] Creating event network-vif-deleted:33e35059-afb9-405e-9e7a-7271d3f1cfce for instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 on hv-cinder-83454 Oct 10 17:18:41.926445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-c86a89d7-3092-4793-b769-d444660aa93c req-ed4d9df0-488c-425f-8bfd-b4f54acf1031 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036165 Oct 10 17:18:41.927049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 470/950] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:42.022650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:42.023387 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:42.030350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:42.034122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:42.034122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:42.034122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:42.034122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:42.034521 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:42.101572 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:42.109250 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1a4ecd1b-eff2-46ec-b8fa-17490f91377e tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1294 microversion: 2.1 time: 0.090543 Oct 10 17:18:42.110004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 481/951] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:42 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:42.919136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:42.919844 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:42.927261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:42.929021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:42.929021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:42.929021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:42.929411 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:42.929840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:42.962578 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:42.963063 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:42.963503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:42.963947 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lazy-loading 'fault' on Instance uuid d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:18:43.006644 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd625c099d9134f78b3e8940879c19106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0d86e93942189945656ccb70c059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:43.014503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2b65930b-6091-4dc9-922b-8c2086a44970 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 200 len: 1230 microversion: 2.1 time: 0.100274 Oct 10 17:18:43.015078 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 471/952] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:42 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:43.132907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:43.133517 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:43.135852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:43.144940 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:43.145565 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:43.146007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:43.146722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:43.147175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:43.147596 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:43.285726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:43.293993 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7f86c396-7c8e-416b-8472-284a15d95d36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.165209 Oct 10 17:18:43.294551 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 482/953] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:43 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:44.045616 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:44.046255 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: d2c61c0c-5d47-44dd-8cb0-12f76cd4a681] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:44.053080 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:44.053574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:44.054022 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:44.054722 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:44.054959 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1c2c42-de59-4f94-8b1d-9b12f40fd360", "tag": "fcf6848a-1466-4fc1-8e5a-93df9e570166"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:44.055182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:44.055609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:44.071188 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] HTTP exception thrown: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. Oct 10 17:18:44.072477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Request method failure captured: Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 HTTP/1.1 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFH5uADiX5nDsoDfKzdmPVi77ARCYNb5tvC4h-JSTsa7t4HIGpfTr1KowbowTpflZ7tEGTBB-MG3H4g7FIMxydJppf-xYuGEQOs69WlUghAZ002-RLGxWgnCNqOBGlpT6kHmIkxcYuCBosag8R3yZYNFtmMAHPRec3UW5oaFnfxydIM Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:18:44.072888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0d86e93942189945656ccb70c059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0d86e93942189945656ccb70c059"}]}] Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: d625c099d9134f78b3e8940879c19106 Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. Oct 10 17:18:44.075126 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'd2c61c0c-5d47-44dd-8cb0-12f76cd4a681'} Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:44.076333 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. Oct 10 17:18:44.077640 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:44.079002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:44.079002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:44.079171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Returning 404 to user: Instance d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:44.079171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ff1c9c8b-3e78-4e8f-bd89-560193084416 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681" status: 404 len: 111 microversion: 2.1 time: 0.033712 Oct 10 17:18:44.079171 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 472/954] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:44 2022] GET /compute/v2.1/servers/d2c61c0c-5d47-44dd-8cb0-12f76cd4a681 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:44.085492 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] Creating event network-changed:fcf6848a-1466-4fc1-8e5a-93df9e570166 for instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 on hv-cinder-83454 Oct 10 17:18:44.090797 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-997ada0d-0651-451c-9c36-ee91d446e388 req-81f709f8-5af3-4e45-bc29-62bb84abc52e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039469 Oct 10 17:18:44.091759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 483/955] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:44.316819 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:44.317418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:44.323734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:44.324734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:44.325172 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:44.326116 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:44.326557 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:44.327308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:44.616680 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:44.626798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f67550b3-dff8-41ac-87ba-4af924d5c18c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.313787 Oct 10 17:18:44.627372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 473/956] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:44 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:45.180945 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:45.181559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:45.187826 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.188337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.188860 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.189559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.190012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.190433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.204535 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] HTTP exception thrown: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Request method failure captured: Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce HTTP/1.1 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFH5uADiX5nDsoDfKzdmPVi77ARCYNb5tvC4h-JSTsa7t4HIGpfTr1KowbowTpflZ7tEGTBB-MG3H4g7FIMxydJppf-xYuGEQOs69WlUghAZ002-RLGxWgnCNqOBGlpT6kHmIkxcYuCBosag8R3yZYNFtmMAHPRec3UW5oaFnfxydIM Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:18:45.206197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0d86e93942189945656ccb70c059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0d86e93942189945656ccb70c059"}]}] Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: d625c099d9134f78b3e8940879c19106 Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.207795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'cead3c66-8618-4516-acda-9378f83705ce'} Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:45.208662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.210055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.211348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Returning 404 to user: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:45.211348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-183838c0-8952-423b-ae3f-8187ad9921e1 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 404 len: 111 microversion: 2.1 time: 0.031463 Oct 10 17:18:45.211348 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 484/957] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:18:45 2022] DELETE /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:45.217215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:45.217825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] [instance: cead3c66-8618-4516-acda-9378f83705ce] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:45.224456 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.224935 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.225362 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.226046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.226494 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.226911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.240291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] HTTP exception thrown: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Request method failure captured: Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce HTTP/1.1 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFH5uADiX5nDsoDfKzdmPVi77ARCYNb5tvC4h-JSTsa7t4HIGpfTr1KowbowTpflZ7tEGTBB-MG3H4g7FIMxydJppf-xYuGEQOs69WlUghAZ002-RLGxWgnCNqOBGlpT6kHmIkxcYuCBosag8R3yZYNFtmMAHPRec3UW5oaFnfxydIM Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:18:45.241818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0d86e93942189945656ccb70c059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0d86e93942189945656ccb70c059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0d86e93942189945656ccb70c059"}]}] Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: c36e0d86e93942189945656ccb70c059 Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-TestVolumeBootPattern-166268628 Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: d625c099d9134f78b3e8940879c19106 Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-TestVolumeBootPattern-166268628-project Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.243393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'cead3c66-8618-4516-acda-9378f83705ce'} Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:18:45.244305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. Oct 10 17:18:45.245629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:18:45.246803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Returning 404 to user: Instance cead3c66-8618-4516-acda-9378f83705ce could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:18:45.246803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-c6bf9fbd-a6b9-46de-8187-3b788f6acde3 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce" status: 404 len: 111 microversion: 2.1 time: 0.030458 Oct 10 17:18:45.246803 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 474/958] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:45 2022] GET /compute/v2.1/servers/cead3c66-8618-4516-acda-9378f83705ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:18:45.650491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:45.651194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:45.657504 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.660375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.660375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.660375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:45.660375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:45.660750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:45.787994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:45.796320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-cb0ee593-8340-455d-94d6-b6b4e6fa1f7d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.150525 Oct 10 17:18:45.796881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 485/959] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:45 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:46.686853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-059a299f-3e0b-49bd-a199-e8ee25adb855 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] Calling method '.version_select at 0x7f34ef15aaf0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:46.760187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-059a299f-3e0b-49bd-a199-e8ee25adb855 tempest-TestVolumeBootPattern-166268628 tempest-TestVolumeBootPattern-166268628-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-764167818" status: 202 len: 0 microversion: 2.1 time: 0.077118 Oct 10 17:18:46.760757 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 475/960] 10.222.0.42 () {58 vars in 1260 bytes} [Mon Oct 10 17:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-764167818 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:18:46.818443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:46.819052 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:46.826789 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:46.827293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:46.827729 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:46.828734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:46.829188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:46.829613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:47.000697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:47.008289 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-393d7022-d1a8-42fe-b634-c249e8c55232 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.193583 Oct 10 17:18:47.008857 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 486/961] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:46 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:48.031931 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:48.033510 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:48.040488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:48.040983 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:48.041415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:48.042379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:48.043987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:48.044438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:48.262117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:48.269698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b8ddcd14-2b67-4ef7-92f1-10178af7d601 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.242766 Oct 10 17:18:48.270357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 476/962] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:48 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:49.293410 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:49.293960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:49.296365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:49.297024 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=6 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:49.301798 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:49.302287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:49.302726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:49.303421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:49.303888 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:49.304331 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:49.455256 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:49.463044 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-98a9ac44-f1e7-4e96-bedb-4c1e2a7ecb94 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.174242 Oct 10 17:18:49.463677 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 487/963] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:49 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:50.296342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1c2c42-de59-4f94-8b1d-9b12f40fd360", "name": "network-vif-plugged", "status": "completed", "tag": "fcf6848a-1466-4fc1-8e5a-93df9e570166"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:50.302334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:50.308597 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:50.309090 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:50.309717 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:50.324197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] Creating event network-vif-plugged:fcf6848a-1466-4fc1-8e5a-93df9e570166 for instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 on hv-cinder-83454 Oct 10 17:18:50.329770 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-1a180273-54a6-4158-865b-a05a6a8ca57a req-9dd1a376-fc9d-447c-afa2-55854462ded3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040130 Oct 10 17:18:50.330627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 477/964] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:50.488863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:50.489655 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:50.500712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:50.501679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:50.502402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:50.503529 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:50.504324 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:50.505298 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:50.639071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:50.650415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b18c744d-f563-42d9-9245-581fc9e5f135 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.166826 Oct 10 17:18:50.651613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 488/965] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:50 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:51.679134 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:51.679848 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:51.687526 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:51.688038 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:51.688544 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:51.689284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:51.689741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:51.690165 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:51.710154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:18:51.824841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:51.832907 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8382f2fd-12ed-4e13-9a88-8f7f50bf7787 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.158879 Oct 10 17:18:51.833561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 478/966] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:51 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:52.854831 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:52.855401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:52.862243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:52.862736 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:52.863170 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:52.865446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:52.865446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:52.865446 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:53.021902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:53.030709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-51a9961a-1cfd-4228-8196-bcd767447f36 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1368 microversion: 2.1 time: 0.179768 Oct 10 17:18:53.031273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 489/967] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:52 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:54.052809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:54.053367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:54.059897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:54.060409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:54.060845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:54.061542 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:54.061994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:54.062424 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:54.198765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:18:54.206666 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-276bc934-3f2f-4e2f-90d9-7bd15c87f1d7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1558 microversion: 2.1 time: 0.157808 Oct 10 17:18:54.207223 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 479/968] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:18:54 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:18:54.228863 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:18:54.229471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:18:54.236427 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:54.236911 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:54.237345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:54.238029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:54.238478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:54.238901 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:54.314188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-05ab81e8-c680-4e49-acf1-ec72e9c478bb tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089272 Oct 10 17:18:54.314786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 490/969] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:18:54 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:18:55.336499 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1c2c42-de59-4f94-8b1d-9b12f40fd360", "tag": "fcf6848a-1466-4fc1-8e5a-93df9e570166"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:18:55.347684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:18:55.348215 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:18:55.348643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:18:55.362162 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] Creating event network-changed:fcf6848a-1466-4fc1-8e5a-93df9e570166 for instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 on hv-cinder-83454 Oct 10 17:18:55.367396 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-bc1a6368-f7dd-4a04-835f-6a045511a549 req-34ca43e7-98c4-4ac3-a167-1c86493e3e2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034588 Oct 10 17:18:55.368566 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 480/970] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:30.802574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=17 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:19:30.803338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=64 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:19:30.807197 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:30.807687 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:30.814210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:30.814697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:30.815132 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:30.815821 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:30.816313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:30.816740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:30.839583 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-200b4113-b700-4ffe-8fec-67564789a7af tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/ips" status: 200 len: 149 microversion: 2.1 time: 0.038702 Oct 10 17:19:30.840164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 491/971] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:19:30 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:32.455553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:19:32.456740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=10 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:19:32.461132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de7fb8a9-ec27-409e-8ebc-72ec69f92e5f"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:19:32.463809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:32.469835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:32.478380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:32.478380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:32.478380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:32.478380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:32.478783 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:33.274453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-23b802fc-6d93-4be2-ab31-355d490b8087 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820695 Oct 10 17:19:33.275055 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 481/972] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:19:32 2022] POST /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:41.856735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de7fb8a9-ec27-409e-8ebc-72ec69f92e5f"}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:19:41.859072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:41.866229 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:41.866714 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:41.867149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:41.867846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:41.868321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:41.868751 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:41.945192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: POST /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments HTTP/1.1 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 74 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:19:41.946795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {"volumeAttachment": {"volumeId": "de7fb8a9-ec27-409e-8ebc-72ec69f92e5f"}} Oct 10 17:19:41.948553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'server_id': '4f1c2c42-de59-4f94-8b1d-9b12f40fd360', 'body': {'volumeAttachment': {'volumeId': 'de7fb8a9-ec27-409e-8ebc-72ec69f92e5f'}}} Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:19:41.949637 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:41.951115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 400 to user: Invalid volume: volume de7fb8a9-ec27-409e-8ebc-72ec69f92e5f is already attached to instances: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d0f5bb82-bd66-4b82-8c0e-7358d4bb9cd4 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095886 Oct 10 17:19:41.953651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 492/973] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:19:41 2022] POST /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 17:19:42.015342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:42.015957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:42.022125 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:42.023938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:42.023938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:42.023938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:42.024311 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:42.024692 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:42.107807 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'services' on Instance uuid 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:19:42.309609 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6c0feda4-b580-45c2-a81b-2e5a5dac9f06 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments/de7fb8a9-ec27-409e-8ebc-72ec69f92e5f" status: 202 len: 0 microversion: 2.1 time: 0.298820 Oct 10 17:19:42.310114 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 482/974] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:19:42 2022] DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments/de7fb8a9-ec27-409e-8ebc-72ec69f92e5f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:19:42.318733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:42.321137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:42.327899 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:42.328438 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:42.328865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:42.329567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:42.329994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:42.330414 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:42.360244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3bd3fa99-562f-4de7-9c28-4cd6b12bd061 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Oct 10 17:19:42.360781 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 493/975] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:19:42 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:43.373784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:43.376561 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:43.383050 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:43.383532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:43.383962 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:43.384669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:43.385113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:43.385531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:43.415705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ea0d27e9-f4b1-4ce4-a897-f42d466239f8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Oct 10 17:19:43.416293 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 483/976] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:19:43 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:44.430116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:44.432353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:44.439345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.439829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.440291 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.440980 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.441433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.441858 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.470441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-47396013-5bf8-4dff-b4cb-f1d04077c958 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046179 Oct 10 17:19:44.470987 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 494/977] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:19:44 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:19:44.533136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:44.533627 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:44.539891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.540393 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.540820 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.541500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.541941 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.542357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.569185 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:19:44.816428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4d94c4be-f4dc-46dc-81f4-1cbd690da6ed tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 204 len: 0 microversion: 2.1 time: 0.286960 Oct 10 17:19:44.817005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 484/978] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:19:44 2022] DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:19:44.825312 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:44.825918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:44.832653 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.833133 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.833565 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.834255 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:44.834708 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:44.835128 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:44.968709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:44.976328 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b72bcad2-c060-4b9b-a851-dae5d3175862 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1682 microversion: 2.1 time: 0.154889 Oct 10 17:19:44.976892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 495/979] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:44 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:46.001995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:46.002648 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:46.009045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:46.009518 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:46.009948 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:46.010624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:46.011072 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:46.011483 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:46.144248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:46.151820 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9f5d6355-f46b-45a4-88aa-eefe21e920d9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1682 microversion: 2.1 time: 0.154980 Oct 10 17:19:46.152405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 485/980] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:45 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:47.174742 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:47.175345 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:47.181610 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:47.182090 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:47.182526 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:47.183213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:47.183662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:47.184173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:47.377386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:47.385047 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-11147fad-a6b7-4d47-b68a-ebacb88a0553 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1682 microversion: 2.1 time: 0.214198 Oct 10 17:19:47.385608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 496/981] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:47 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:48.116685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1c2c42-de59-4f94-8b1d-9b12f40fd360", "name": "network-vif-deleted", "tag": "fcf6848a-1466-4fc1-8e5a-93df9e570166"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:19:48.127118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:48.127589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:48.128170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:48.141261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] Creating event network-vif-deleted:fcf6848a-1466-4fc1-8e5a-93df9e570166 for instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 on hv-cinder-83454 Oct 10 17:19:48.146500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-b608e242-6d7a-48d3-a381-a4224765d93d req-6aaeafa2-8015-440f-9cdd-9eb489d1cfa2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272599 Oct 10 17:19:48.147469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 486/982] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:48.408216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:48.408759 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:48.415019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:48.415502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:48.415934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:48.416728 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:48.417182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:48.417602 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:48.448550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:48.449031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:48.449464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:48.449906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:19:48.493415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:48.500944 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-669b0725-d922-49eb-b6a0-ec2e9498c8fe tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 200 len: 1332 microversion: 2.1 time: 0.097178 Oct 10 17:19:48.501510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 497/983] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:48 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:49.523768 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:49.524483 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:49.531060 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:49.531538 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:49.531978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:49.532679 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:49.533122 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:49.533538 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:49.546973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 HTTP/1.1 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:19:49.548577 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:19:49.550163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '4f1c2c42-de59-4f94-8b1d-9b12f40fd360'} Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:19:49.551236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:19:49.552795 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:19:49.554317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:19:49.554317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d5b8a7ec-fc0d-418d-b563-a660f22165e7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 404 len: 111 microversion: 2.1 time: 0.030337 Oct 10 17:19:49.554317 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 487/984] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:49 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:19:49.558485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-ad20dd34-75ad-46ac-b15f-641dba58ea0c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '.version_select at 0x7f34ef480b80>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:49.662554 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-ad20dd34-75ad-46ac-b15f-641dba58ea0c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279973504" status: 202 len: 0 microversion: 2.1 time: 0.107735 Oct 10 17:19:49.663112 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 498/985] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 10 17:19:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279973504 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:19:50.653161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-84057b4d-91c5-4003-85be-b0ab1ffeb78f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: .version_select at 0x7f34ef15a550>, body: {"keypair": {"name": "tempest-keypair-667961544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNkgxhndBDro3wqvGWT1ANKOQXSyX6rodK5X85d+pUhwHMVu6PIgeG8Yflew5B7pKpZ2kKNFwiuv4NKSIf2YX3xEYS/aZ2Dg7PjTIb9r8jMSWJw5rtwFf/nkOPfFoz7fA=="}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:19:50.669482 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-84057b4d-91c5-4003-85be-b0ab1ffeb78f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:19:50.673933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-84057b4d-91c5-4003-85be-b0ab1ffeb78f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'key_pairs'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:19:50.749094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-84057b4d-91c5-4003-85be-b0ab1ffeb78f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099841 Oct 10 17:19:50.749694 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 488/986] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:19:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:19:53.109365 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-329878647", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0"}], "security_groups": [{"name": "tempest-securitygroup--834201636"}], "key_name": "tempest-keypair-667961544", "user_data": "}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:19:53.212416 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] validate_networks() for [('87222dc5-bfc9-4e5d-99dd-9e26eb1b32f0', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:19:53.661935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:19:53.662380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:19:53.662876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:19:53.663270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:19:53.663682 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:19:53.673175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:53.673661 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:53.674099 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:53.674822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:53.675278 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:53.675701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:53.692904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:19:53.696832 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Getting quotas for user 50d98bc599f74688b7f9fea92ee7c2ea and project f4fa5392cfd049509a86b2d88d536409. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:19:53.707848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:19:53.710136 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:19:53.849847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-4dc6a8f1-a166-4d3c-9f32-3e9d9b1661b3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.745946 Oct 10 17:19:53.850415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 499/987] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:19:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:19:53.862925 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6c1130d5-3a4a-4660-b1d0-d4c5aa104a24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:53.871729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6c1130d5-3a4a-4660-b1d0-d4c5aa104a24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:53.917309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6c1130d5-3a4a-4660-b1d0-d4c5aa104a24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:53.924039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6c1130d5-3a4a-4660-b1d0-d4c5aa104a24 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1240 microversion: 2.1 time: 0.066420 Oct 10 17:19:53.924650 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 489/988] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:53 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:54.947277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c9eb4c5a-3fe7-403f-a4c6-e055b593cb21 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:54.947864 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c9eb4c5a-3fe7-403f-a4c6-e055b593cb21 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:55.001996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c9eb4c5a-3fe7-403f-a4c6-e055b593cb21 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:55.009325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c9eb4c5a-3fe7-403f-a4c6-e055b593cb21 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1240 microversion: 2.1 time: 0.066583 Oct 10 17:19:55.010374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 500/989] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:54 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:56.031967 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e4444d6a-8c88-4049-9090-a77eb20b39a3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:56.032630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e4444d6a-8c88-4049-9090-a77eb20b39a3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:56.085189 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e4444d6a-8c88-4049-9090-a77eb20b39a3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:56.092270 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e4444d6a-8c88-4049-9090-a77eb20b39a3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1240 microversion: 2.1 time: 0.064086 Oct 10 17:19:56.095866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 490/990] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:56 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:57.115220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9a7fbcd9-b0a3-4f41-815f-295d37782c96 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:57.115874 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9a7fbcd9-b0a3-4f41-815f-295d37782c96 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:57.171089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9a7fbcd9-b0a3-4f41-815f-295d37782c96 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:57.177873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9a7fbcd9-b0a3-4f41-815f-295d37782c96 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1240 microversion: 2.1 time: 0.066606 Oct 10 17:19:57.178423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 501/991] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:57 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:58.201421 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:58.202894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:58.210168 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:58.210652 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:58.211081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:58.211770 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:58.212249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:58.212671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:58.272444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:58.280138 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2c1f8ce0-a8b4-410b-8aa4-686409aa1ca1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1244 microversion: 2.1 time: 0.082569 Oct 10 17:19:58.280690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 491/992] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:58 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:19:59.302639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:19:59.303233 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:19:59.310115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:59.310664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:59.311104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:59.312430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:19:59.312880 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:19:59.313299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:19:59.372262 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:19:59.381069 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8d3302f2-6e3f-4828-b1a4-881544b3853d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1236 microversion: 2.1 time: 0.082212 Oct 10 17:19:59.381871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 502/993] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:19:59 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:00.404290 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:00.407915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:00.411387 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:00.411867 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:00.412332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:00.413017 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:00.413465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:00.413883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:00.508269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:00.516634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fd5d5a9f-145e-4ad0-b92f-f409868985b0 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1298 microversion: 2.1 time: 0.116326 Oct 10 17:20:00.517201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 492/994] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:00 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:01.539510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:01.548907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:01.548907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:01.548907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:01.548907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:01.549318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:01.549318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:01.549495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:01.751360 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:01.759074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-04c795fc-ee81-4519-9025-d6d84786719a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.223440 Oct 10 17:20:01.759645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 503/995] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:01 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:01.823358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d785bbb-e098-44f2-b528-c01733d40cfc", "tag": "8daaf9ca-0570-4b0a-b7d3-9afdc08d4892"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:20:01.834156 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:01.834624 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:01.835239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:01.846922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] Creating event network-changed:8daaf9ca-0570-4b0a-b7d3-9afdc08d4892 for instance 1d785bbb-e098-44f2-b528-c01733d40cfc on hv-cinder-83454 Oct 10 17:20:01.851959 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-2bd5d12e-779b-48df-94c1-cd00dff684ec req-11f58b9d-a1f5-45aa-918c-516a5d5f3ae6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032243 Oct 10 17:20:01.852583 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 493/996] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:02.782366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:02.783012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:02.789662 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:02.790148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:02.790586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:02.791277 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:02.791727 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:02.792188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:02.926906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:02.934425 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-eb369ed1-68d2-45e5-8626-344b2877b2e2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.155926 Oct 10 17:20:02.934989 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 504/997] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:02 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:03.958989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:03.959761 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:03.961709 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:03.966619 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:03.967107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:03.974167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:03.974167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:03.974167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:03.974167 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:03.974554 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:04.101662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:04.109744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8295430a-c989-4227-997d-beef96be9dce tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.155601 Oct 10 17:20:04.110307 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 494/998] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:03 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:05.132806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:05.133347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:05.135392 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:05.141342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:05.141828 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:05.142266 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:05.142997 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:05.143454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:05.143879 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:05.272846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:05.280534 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-969f3188-ed6a-4ea0-806b-51454022265f tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.151624 Oct 10 17:20:05.281096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 505/999] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:05 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:06.303763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:06.304458 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:06.307099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=8 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:06.313209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:06.313691 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:06.314175 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:06.314881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:06.315316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:06.318899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:06.450912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:06.459564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-22b4e596-472b-462a-967f-77ef913840aa tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.160398 Oct 10 17:20:06.460470 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 495/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:06 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:06.615148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d785bbb-e098-44f2-b528-c01733d40cfc", "name": "network-vif-plugged", "status": "completed", "tag": "8daaf9ca-0570-4b0a-b7d3-9afdc08d4892"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:20:06.625412 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:06.625896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:06.626334 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:06.637407 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] Creating event network-vif-plugged:8daaf9ca-0570-4b0a-b7d3-9afdc08d4892 for instance 1d785bbb-e098-44f2-b528-c01733d40cfc on hv-cinder-83454 Oct 10 17:20:06.642996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-3b3865ee-02e7-4b51-9be2-0fbd57673046 req-d3bbca88-c583-4543-a12f-96a1288756ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089638 Oct 10 17:20:06.643584 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 506/1001] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:07.482637 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:07.483809 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:07.485753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:20:07.485897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc (ip 10.222.0.42) !!! Oct 10 17:20:07.492347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:07.492822 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:07.493250 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:07.493933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:07.494379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:07.494799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:07.622161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:07.630390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fb01fe66-f287-4f8b-8f77-66528d3718f9 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.151599 Oct 10 17:20:07.630952 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 496/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:07 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:08.650313 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=10 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:08.655434 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:08.656194 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:08.662302 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:08.662816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:08.663244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:08.663930 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:08.664405 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:08.669077 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:08.794516 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:08.802270 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-63b58119-3375-4085-8cab-fa5f37471ebc tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1365 microversion: 2.1 time: 0.152944 Oct 10 17:20:08.802836 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 507/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:08 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:09.825352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:09.825899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:09.832621 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:09.833108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:09.833548 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:09.834240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:09.834697 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:09.835123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:09.964740 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:09.972428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8a724ca0-f942-45fe-a367-b571e9c18a4c tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1555 microversion: 2.1 time: 0.150996 Oct 10 17:20:09.973033 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 497/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:09 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:20:09.996611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:09.997123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:10.004367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:10.004926 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:10.005418 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:10.006118 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:10.006570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:10.006996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:10.086140 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1eb5fc1f-880d-4e2b-95e0-5c9a861ea894 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093595 Oct 10 17:20:10.086733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 508/1005] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 10 17:20:09 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:11.291338 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d785bbb-e098-44f2-b528-c01733d40cfc", "tag": "8daaf9ca-0570-4b0a-b7d3-9afdc08d4892"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:20:11.301042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:11.301519 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:11.301950 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:11.312662 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] Creating event network-changed:8daaf9ca-0570-4b0a-b7d3-9afdc08d4892 for instance 1d785bbb-e098-44f2-b528-c01733d40cfc on hv-cinder-83454 Oct 10 17:20:11.317645 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-38c0373f-d167-49d3-952e-5a653696d627 req-b21cd7be-e346-4515-8e87-d4c0232a8297 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029936 Oct 10 17:20:11.318234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 498/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:47.006362 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:47.007029 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=80 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:47.060138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:47.062225 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:47.066264 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:47.066722 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:47.067149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:47.067830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:47.068316 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:47.068735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:47.092168 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-19392a55-10a8-49c4-840e-79f7aa40ce00 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/ips" status: 200 len: 150 microversion: 2.1 time: 0.086859 Oct 10 17:20:47.092699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 509/1007] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 10 17:20:47 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:48.617737 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=9 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:48.618468 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=25 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:48.622707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef6b1c30-36c2-46e0-a86f-db226f48b2c9"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:20:48.626946 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:48.631713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:48.632241 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:48.632678 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:48.633367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:48.633826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:48.634248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:49.456271 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-46faf5d0-8646-4ba2-88fa-903916dc02c5 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "POST /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840080 Oct 10 17:20:49.456880 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 499/1008] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 10 17:20:48 2022] POST /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:57.081761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:57.082257 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:57.085787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:20:57.089458 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:57.090195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:57.090364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:57.091013 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:57.091457 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:57.091871 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:57.170644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'services' on Instance uuid 1d785bbb-e098-44f2-b528-c01733d40cfc {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:20:57.319249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2e90f187-b654-4a58-9a3f-25c498d133c2 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments/ef6b1c30-36c2-46e0-a86f-db226f48b2c9" status: 202 len: 0 microversion: 2.1 time: 0.242110 Oct 10 17:20:57.319830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 510/1009] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 10 17:20:57 2022] DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments/ef6b1c30-36c2-46e0-a86f-db226f48b2c9 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:20:57.330402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:57.332927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:57.339075 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:57.339559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:57.339995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:57.340765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:57.341211 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:57.341638 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:57.373049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-dab9a8ea-6d25-40ac-bc76-66d1d415e93d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048581 Oct 10 17:20:57.373599 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 500/1010] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:20:57 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:58.387463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:58.390876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:58.396040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:58.400600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:58.400600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:58.400600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:58.400600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:58.401144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:58.430191 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-40e2166a-c0c3-4313-951e-c23dab2b55b1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Oct 10 17:20:58.430745 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 511/1011] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:20:58 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:20:59.443416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:59.445617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:59.452014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.452530 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.453212 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.453920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.454399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.454812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.482972 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-342a22e1-c607-4d79-854e-0f3dfaa25866 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043609 Oct 10 17:20:59.484042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 501/1012] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 10 17:20:59 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 17:20:59.544900 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:59.545422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:59.552321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.552801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.553240 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.553919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.554367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.554788 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.581829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:20:59.788960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8a2437eb-d57e-4c1d-a057-785551d4de6a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 204 len: 0 microversion: 2.1 time: 0.247472 Oct 10 17:20:59.789477 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 512/1013] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:20:59 2022] DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:20:59.798101 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:20:59.798712 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:20:59.804713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.805202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.805675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.806373 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:20:59.806829 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:20:59.807256 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:20:59.936239 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:20:59.943980 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ea181d3b-9b0f-402d-86ea-258bbb186887 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1680 microversion: 2.1 time: 0.150311 Oct 10 17:20:59.944575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 502/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:20:59 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:00.968633 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:00.969252 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:00.975545 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:00.976037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:00.976475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:00.977184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:00.977635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:00.978052 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:01.109357 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:01.117049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3484b859-d0e4-40c7-ab5f-5b23751abfb3 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1680 microversion: 2.1 time: 0.152732 Oct 10 17:21:01.117603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 513/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:00 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:02.140514 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:02.141110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:02.147481 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:02.147971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:02.148444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:02.149250 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:02.149592 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:02.150015 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:02.340077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:02.348982 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e1a2025d-c77d-4847-b282-554f00bcbd83 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1680 microversion: 2.1 time: 0.212400 Oct 10 17:21:02.349747 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 503/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:02 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:02.805937 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d785bbb-e098-44f2-b528-c01733d40cfc", "name": "network-vif-deleted", "tag": "8daaf9ca-0570-4b0a-b7d3-9afdc08d4892"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:21:02.817353 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:02.817827 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:02.818252 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:02.830167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] Creating event network-vif-deleted:8daaf9ca-0570-4b0a-b7d3-9afdc08d4892 for instance 1d785bbb-e098-44f2-b528-c01733d40cfc on hv-cinder-83454 Oct 10 17:21:02.836539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-86d25bbd-8e0f-454e-92be-a23c11aea8ec req-e19a8f89-9202-487a-a39f-ac784e0cd037 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Oct 10 17:21:02.836539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 514/1017] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:21:03.376843 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:03.377591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:03.383818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:03.384391 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:03.384830 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:03.385556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:03.386007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:03.386430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:03.418428 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:03.418915 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:03.419347 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:03.419796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lazy-loading 'fault' on Instance uuid 1d785bbb-e098-44f2-b528-c01733d40cfc {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:21:03.461289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d98bc599f74688b7f9fea92ee7c2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa5392cfd049509a86b2d88d536409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:03.470005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5e4557c9-c55f-49a6-8c6f-94c5ba1efb3d tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 200 len: 1330 microversion: 2.1 time: 0.096623 Oct 10 17:21:03.470584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 504/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:03 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:04.494747 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:04.495435 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:04.502137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:04.502621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:04.503053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:04.503726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:04.504199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:04.504618 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:04.517597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc HTTP/1.1 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:21:04.519183 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:04.520846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '1d785bbb-e098-44f2-b528-c01733d40cfc'} Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:04.524870 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:04.526409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:04.527794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:04.527794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-7b91d904-a660-43e5-b432-64db33ea4626 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 404 len: 111 microversion: 2.1 time: 0.030606 Oct 10 17:21:04.527794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 515/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:04 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:04.529219 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-fefa10c9-e37a-4a37-8c6e-1ba63dda9522 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '.version_select at 0x7f34ef5773a0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:04.605503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-fefa10c9-e37a-4a37-8c6e-1ba63dda9522 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667961544" status: 202 len: 0 microversion: 2.1 time: 0.079940 Oct 10 17:21:04.606106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 505/1020] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 10 17:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667961544 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:21:06.632111 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:06.632603 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:06.638815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:06.639293 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:06.639724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:06.640433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:06.640881 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:06.641299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:06.654712 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc HTTP/1.1 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:21:06.656245 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.658368 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '1d785bbb-e098-44f2-b528-c01733d40cfc'} Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:06.659433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.661054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.662619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:06.662619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8bda64ca-03f2-4477-b64b-e255898b14d8 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 404 len: 111 microversion: 2.1 time: 0.029351 Oct 10 17:21:06.662619 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 516/1021] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:21:06 2022] DELETE /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:06.666794 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:06.667459 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 1d785bbb-e098-44f2-b528-c01733d40cfc] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:06.673891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:06.674366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:06.674798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:06.675480 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:06.675924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:06.676366 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:06.688917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc HTTP/1.1 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:21:06.690531 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.692105 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '1d785bbb-e098-44f2-b528-c01733d40cfc'} Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:06.693094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. Oct 10 17:21:06.694845 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:06.696513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 1d785bbb-e098-44f2-b528-c01733d40cfc could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:06.696513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e564112b-7db8-41fd-92b9-cd5463cd6ef1 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc" status: 404 len: 111 microversion: 2.1 time: 0.029373 Oct 10 17:21:06.696513 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 506/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:06 2022] GET /compute/v2.1/servers/1d785bbb-e098-44f2-b528-c01733d40cfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 17:21:07.933184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:07.933709 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:07.940124 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:07.940598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:07.941028 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:07.941704 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:07.942149 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:07.942566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:07.955787 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 HTTP/1.1 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:21:07.957325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.958904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '4f1c2c42-de59-4f94-8b1d-9b12f40fd360'} Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:07.959816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.961092 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.962355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:07.962355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5d2ca39c-32e1-4f76-a8fd-6252abc2bf62 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 404 len: 111 microversion: 2.1 time: 0.029354 Oct 10 17:21:07.962355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 517/1023] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:21:07 2022] DELETE /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:07.966965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:07.967575 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 4f1c2c42-de59-4f94-8b1d-9b12f40fd360] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:07.974463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:07.974944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:07.975380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:07.976106 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:07.976558 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:07.976981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:07.990522 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 HTTP/1.1 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:21:07.992049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.993634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '4f1c2c42-de59-4f94-8b1d-9b12f40fd360'} Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:07.994463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. Oct 10 17:21:07.995920 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:07.997328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 4f1c2c42-de59-4f94-8b1d-9b12f40fd360 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:07.997328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-4262e74f-b606-4578-899d-28ec7dc75d23 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360" status: 404 len: 111 microversion: 2.1 time: 0.030301 Oct 10 17:21:07.997328 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 507/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:07 2022] GET /compute/v2.1/servers/4f1c2c42-de59-4f94-8b1d-9b12f40fd360 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:08.002659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:08.002659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:08.008119 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:08.008595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:08.009023 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:08.009697 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:08.010139 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:08.010570 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:08.023590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b HTTP/1.1 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:21:08.025167 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.026705 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'b3c3b1c7-1726-4fa0-81c8-a7d2892c895b'} Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:08.027600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.029159 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.030882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:08.030882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-185aea2c-c3a5-48c8-96dc-3d6b052ef89a tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 404 len: 111 microversion: 2.1 time: 0.028620 Oct 10 17:21:08.030882 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 518/1025] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:21:07 2022] DELETE /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:08.035266 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:08.035876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: b3c3b1c7-1726-4fa0-81c8-a7d2892c895b] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:08.041704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:08.042183 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:08.042615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:08.043304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:08.043753 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:08.044201 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:08.057841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b HTTP/1.1 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:21:08.059344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.060968 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': 'b3c3b1c7-1726-4fa0-81c8-a7d2892c895b'} Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:08.061876 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. Oct 10 17:21:08.063356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:08.065039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance b3c3b1c7-1726-4fa0-81c8-a7d2892c895b could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:08.065039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-407a5bcf-bbb4-4609-9135-8e795e14b814 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b" status: 404 len: 111 microversion: 2.1 time: 0.029782 Oct 10 17:21:08.065039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 508/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:08 2022] GET /compute/v2.1/servers/b3c3b1c7-1726-4fa0-81c8-a7d2892c895b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:09.361440 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:09.361939 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:09.368259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:09.368740 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:09.369173 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:09.369852 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:09.370302 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:09.370721 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:09.384382 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 HTTP/1.1 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:21:09.385897 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.387478 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '622151bc-b582-4981-a615-3839765b0b75'} Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:09.388269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.389498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.390719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:09.390719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9d3de15b-2b42-4a0a-932c-9576f6d41d97 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 404 len: 111 microversion: 2.1 time: 0.029630 Oct 10 17:21:09.390719 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 519/1027] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:21:09 2022] DELETE /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:09.396355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:09.396994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] [instance: 622151bc-b582-4981-a615-3839765b0b75] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:09.403358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:09.403841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:09.404313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:09.405008 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:09.405465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:09.405890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:09.419014 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] HTTP exception thrown: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Request method failure captured: Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 HTTP/1.1 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFMqqzjhfKk396O0L_8iyz852u7AkfTUx6HNuUH7FmRFBR_74yI6M-3VlPn47bNuddtiQSii-a1RZ5XRgHeS1Mg7k3hkUSXMpHvfumYF_DqDZ0Ev37bWTvNTbFdlrqVd0i7lwMu2dmbYJJeJNLEydrC_NrBR9v6idpgti68CEynmbrM Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:21:09.420564 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4fa5392cfd049509a86b2d88d536409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4fa5392cfd049509a86b2d88d536409"}]}] Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: f4fa5392cfd049509a86b2d88d536409 Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857763316 Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 50d98bc599f74688b7f9fea92ee7c2ea Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-AttachVolumeNegativeTest-857763316-project Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.422136 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '622151bc-b582-4981-a615-3839765b0b75'} Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:21:09.422953 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. Oct 10 17:21:09.424222 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:21:09.425306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] Returning 404 to user: Instance 622151bc-b582-4981-a615-3839765b0b75 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:21:09.425306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-478f87e5-2baf-4475-a771-f928ca3715a7 tempest-AttachVolumeNegativeTest-857763316 tempest-AttachVolumeNegativeTest-857763316-project] 10.222.0.42 "GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 10 17:21:09.425306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 509/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:09 2022] GET /compute/v2.1/servers/622151bc-b582-4981-a615-3839765b0b75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:21:42.729632 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1124814467", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "networks": [{"uuid": "37baa068-db70-4cc8-b013-454f3dc78194"}]}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:21:42.739220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:42.739865 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:42.785344 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.network.neutron [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] validate_networks() for [('37baa068-db70-4cc8-b013-454f3dc78194', None, None, None, None, None)] {{(pid=119263) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:21:43.125904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Flavor limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:21:43.126342 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Image limits 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:21:43.126815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Flavor pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:21:43.127220 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Image pref 0:0:0 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:21:43.127626 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.virt.hardware [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:21:43.136470 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:43.136949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:43.137381 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:43.138106 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:43.138556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:43.138979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:43.155849 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Getting quotas for project 9888d15cc64842d397087e5c5265ca64. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:21:43.160326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Getting quotas for user 9b63724faba746b5b4df8bba23c08948 and project 9888d15cc64842d397087e5c5265ca64. Resources: {'cores', 'ram', 'instances'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:21:43.171032 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Going to run 1 instances... {{(pid=119263) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:21:43.173329 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:21:43.304184 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c88d8302-6020-442a-a1a2-5b986856af60 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578206 Oct 10 17:21:43.304734 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 520/1029] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:21:43.317378 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-331e4430-aa3f-41ee-857c-6571f3fc5a1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:43.318405 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-331e4430-aa3f-41ee-857c-6571f3fc5a1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:43.325840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:43.327024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:43.413306 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-331e4430-aa3f-41ee-857c-6571f3fc5a1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:43.420463 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-331e4430-aa3f-41ee-857c-6571f3fc5a1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1214 microversion: 2.1 time: 0.108125 Oct 10 17:21:43.421089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 510/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:43 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:44.443745 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:44.444427 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:44.451276 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:44.451764 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:44.452226 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:44.452909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:44.453623 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:44.454137 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:44.520558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:44.529254 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b2a425d5-a8e6-4fbc-b77a-a407b70e892e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1218 microversion: 2.1 time: 0.090068 Oct 10 17:21:44.529840 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 521/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:44 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:45.554629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:45.555179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:45.565639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:45.567309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:45.567309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:45.567309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:45.567846 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:45.568296 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:45.629902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:45.637719 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f9225a3e-86c7-4681-bbb4-67aa825816f1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1266 microversion: 2.1 time: 0.087509 Oct 10 17:21:45.638299 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 511/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:45 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:46.661587 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:46.662199 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:46.668960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:46.669445 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:46.669884 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:46.670574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:46.671031 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:46.671466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:46.874746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:46.882994 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2a612143-6482-4f12-97b1-218c8b9d9470 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.225404 Oct 10 17:21:46.883553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 522/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:46 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:47.736765 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635cd4eb-8947-4063-955f-e59d250a6a0c", "tag": "e250d911-1986-4e91-a793-0b33409eea5c"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:21:47.747683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:47.748192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:47.748623 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:47.759754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] Creating event network-changed:e250d911-1986-4e91-a793-0b33409eea5c for instance 635cd4eb-8947-4063-955f-e59d250a6a0c on hv-cinder-83454 Oct 10 17:21:47.764784 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-117e0be9-4a5c-479a-8139-0f93ee34b467 req-9aadd40d-e40c-41cc-b3c8-469c880c71a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032324 Oct 10 17:21:47.765375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 512/1034] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:21:47.906121 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:47.906720 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:47.912942 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:47.913423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:47.913850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:47.914531 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:47.914978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:47.915397 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:48.111654 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:48.119275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0d637f1d-7403-4fdb-920d-371436f5e933 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.217061 Oct 10 17:21:48.119835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 523/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:47 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:49.144220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:49.144874 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:49.151189 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:49.151670 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:49.152132 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:49.152821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:49.153291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:49.153695 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:49.283398 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:49.291505 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-aa06dae1-72a3-4868-b97b-7423243cfa0f tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.152562 Oct 10 17:21:49.292083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 513/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:49 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:50.313887 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:50.314495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:50.320867 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:50.321350 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:50.321782 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:50.322464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:50.322918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:50.323337 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:50.451287 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:50.459310 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d0c7d396-6bc7-4062-8a4b-dc18c4d94a97 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.149316 Oct 10 17:21:50.459966 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 524/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:50 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:51.481648 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:51.482247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:51.489374 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:51.489852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:51.490280 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:51.491001 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:51.491446 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:51.491887 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:51.621422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:51.626994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3a41cf4c-7110-4451-9282-976a970bc6e7 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.149230 Oct 10 17:21:51.627560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 514/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:51 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:52.649089 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:52.649696 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:52.656040 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:52.656537 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:52.656973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:52.657660 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:52.658109 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:52.658848 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:52.795799 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:52.804068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-5932d998-8eb0-4096-8f13-45371ef09266 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.158799 Oct 10 17:21:52.809510 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 525/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:52 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:53.059517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cd4eb-8947-4063-955f-e59d250a6a0c", "name": "network-vif-plugged", "status": "completed", "tag": "e250d911-1986-4e91-a793-0b33409eea5c"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:21:53.069934 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:53.070431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:53.070840 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:53.082312 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] Creating event network-vif-plugged:e250d911-1986-4e91-a793-0b33409eea5c for instance 635cd4eb-8947-4063-955f-e59d250a6a0c on hv-cinder-83454 Oct 10 17:21:53.087170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-09419334-fa54-4adb-a5a0-cb0632b8919c req-dab30716-a91e-4e20-a605-a4cd7036de99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Oct 10 17:21:53.087742 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 515/1040] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:21:53.826564 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:53.827157 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:53.829286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:53.829949 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=6 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:53.835156 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:53.835638 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:53.836102 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:53.836791 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:53.837241 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:53.837659 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:53.967761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:53.975285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f5fd4d14-30e2-4cd6-a1b2-7bfb552daf1d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.152595 Oct 10 17:21:53.975843 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 526/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:53 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:54.995681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:21:55.000209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:55.000911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:55.007490 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:55.007980 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:55.008446 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:55.009140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:55.009595 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:55.010020 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:55.138430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:55.146154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-cc09f933-0354-430a-8abb-b8a9d3957786 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1314 microversion: 2.1 time: 0.151570 Oct 10 17:21:55.146707 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 516/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:54 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:56.169590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:56.170196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:56.176928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:56.177415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:56.177850 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:56.178562 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:56.179043 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:56.179461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:56.306332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:56.314005 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8d98b980-743b-4744-b0eb-ccd8753d5373 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1498 microversion: 2.1 time: 0.148468 Oct 10 17:21:56.314561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 527/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:56 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:57.240573 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:57.241094 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:57.247342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:57.247827 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:57.248297 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:57.248987 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:57.249438 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:57.249860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:57.275556 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:21:57.536344 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-879250b6-b550-4a9f-8732-ef6d7d355e65 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "DELETE /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 204 len: 0 microversion: 2.1 time: 0.299250 Oct 10 17:21:57.536853 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 517/1044] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:21:57 2022] DELETE /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:21:57.544981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:57.545574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:57.552104 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:57.552591 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:57.553030 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:57.553726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:57.554182 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:57.554605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:57.683141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:57.691421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9790d0a3-084d-4830-93d8-287adef7ad80 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1504 microversion: 2.1 time: 0.150266 Oct 10 17:21:57.691979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 528/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:57 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:58.714633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:58.715325 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:58.722302 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:58.722781 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:58.723210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:58.723957 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:58.724440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:58.724859 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:58.850757 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:58.858551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-bf8ae674-d048-4ad5-97dc-e4f7ae6bfeb9 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1504 microversion: 2.1 time: 0.148154 Oct 10 17:21:58.859117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 518/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:58 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:21:59.641400 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cd4eb-8947-4063-955f-e59d250a6a0c", "name": "network-vif-deleted", "tag": "e250d911-1986-4e91-a793-0b33409eea5c"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:21:59.651485 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:59.651953 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:59.652415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:59.663838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] Creating event network-vif-deleted:e250d911-1986-4e91-a793-0b33409eea5c for instance 635cd4eb-8947-4063-955f-e59d250a6a0c on hv-cinder-83454 Oct 10 17:21:59.668924 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-fd11c649-2c48-4b47-8f86-97b88939c27a req-8cc5944a-8826-4e49-aea1-713c18c8037b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Oct 10 17:21:59.669482 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 529/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:21:59.881440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:21:59.882047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:21:59.888516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:59.888988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:59.889419 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:59.890104 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:21:59.890588 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:21:59.891011 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:21:59.952059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:21:59.960465 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a46e99b0-3639-4887-9f82-bbaf889342c5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 200 len: 1299 microversion: 2.1 time: 0.083025 Oct 10 17:21:59.961023 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 519/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:21:59 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:00.984885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:00.985574 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 635cd4eb-8947-4063-955f-e59d250a6a0c] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:00.991628 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:00.992119 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:00.992549 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:00.993223 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:00.993664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:00.994076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:01.007500 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] HTTP exception thrown: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Request method failure captured: Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c HTTP/1.1 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFSkbdsVzzZ5g2Az4e-uYSWa7G3na-AGzxBP5yqotKvkRdrXDbH6RqRfpIzB0hywKfQm5yNvw4tTuN9DJpyRNH4Iec0d1QIECIQdJR2PQ_YvSkFX_XxIyYVvtFr8N5WgqZHgnI6e8wCvGUEYhxDagnyTEv_CLRUmMPcDdChewBS_T3g Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 9888d15cc64842d397087e5c5265ca64 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesActionsTest-597891420 Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:22:01.009126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9888d15cc64842d397087e5c5265ca64"}]}] Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesActionsTest-597891420 Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 9888d15cc64842d397087e5c5265ca64 Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesActionsTest-597891420 Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesActionsTest-597891420-project Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 9b63724faba746b5b4df8bba23c08948 Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesActionsTest-597891420-project Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. Oct 10 17:22:01.010838 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '635cd4eb-8947-4063-955f-e59d250a6a0c'} Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:22:01.011809 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. Oct 10 17:22:01.013415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:01.014783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Returning 404 to user: Instance 635cd4eb-8947-4063-955f-e59d250a6a0c could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:22:01.014783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8e0aa4d4-4716-4845-9724-db5525d70925 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c" status: 404 len: 111 microversion: 2.1 time: 0.030308 Oct 10 17:22:01.014783 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 530/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:00 2022] GET /compute/v2.1/servers/635cd4eb-8947-4063-955f-e59d250a6a0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:22:01.058159 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-928595657", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452", "networks": [{"uuid": "37baa068-db70-4cc8-b013-454f3dc78194"}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:22:01.111371 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] validate_networks() for [('37baa068-db70-4cc8-b013-454f3dc78194', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:22:01.503713 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:22:01.504196 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:22:01.504671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:22:01.505081 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:22:01.505487 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:22:01.514278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:01.514779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:01.515279 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:01.515981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:01.516464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:01.516888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:01.533110 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Getting quotas for project 9888d15cc64842d397087e5c5265ca64. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:22:01.537135 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Getting quotas for user 9b63724faba746b5b4df8bba23c08948 and project 9888d15cc64842d397087e5c5265ca64. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:22:01.547758 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:22:01.550559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:22:01.715064 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-17e34e88-42e4-49c7-b13f-32343747459c tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660835 Oct 10 17:22:01.715710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 520/1050] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:22:01.727019 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-46dab861-1b97-4de4-98ce-5caf1035c560 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:01.727617 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-46dab861-1b97-4de4-98ce-5caf1035c560 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:01.781067 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-46dab861-1b97-4de4-98ce-5caf1035c560 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:01.788606 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-46dab861-1b97-4de4-98ce-5caf1035c560 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1213 microversion: 2.1 time: 0.065527 Oct 10 17:22:01.789160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 531/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:01 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:22:02.811380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:02.812108 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:02.819352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:02.819835 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:02.820289 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:02.820981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:02.821431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:02.821871 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:02.885205 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:02.893480 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e13c8136-790d-4300-92ff-5660fd0a8f17 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1217 microversion: 2.1 time: 0.085938 Oct 10 17:22:02.894046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 521/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:02 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:03.916244 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:03.917049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:03.924763 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:03.925253 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:03.925685 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:03.926369 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:03.926853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:03.927275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:04.019771 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:04.028493 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9a25e8fa-70f4-47e9-ae52-f0d016fd87bb tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1273 microversion: 2.1 time: 0.116063 Oct 10 17:22:04.029066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 532/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:03 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:05.053120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:05.053738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:05.059736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:05.060261 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:05.060701 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:05.061395 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:05.061850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:05.062278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:05.509718 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:05.517491 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b1c619bf-6924-4f2b-8a13-fc1936364e71 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.469027 Oct 10 17:22:05.518059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 522/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:05 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:05.787231 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ec43b4-8b60-44e3-8060-4b40773e8bf5", "tag": "f3d981b0-c33f-458a-b1f6-0c94193f922e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:22:05.797358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:05.802472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:05.802472 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:05.809766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] Creating event network-changed:f3d981b0-c33f-458a-b1f6-0c94193f922e for instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 on hv-cinder-83454 Oct 10 17:22:05.814803 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-01685158-a7b7-4ec8-b870-04c05531a175 req-0d7c3f09-89d4-4270-a222-3782996069e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031264 Oct 10 17:22:05.815392 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 533/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:22:06.541863 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:06.542416 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:06.548730 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:06.549209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:06.549653 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:06.550914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:06.551364 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:06.551778 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:06.682093 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:06.689606 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e6c169b5-d882-494a-bda9-59faeba3bca5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.151752 Oct 10 17:22:06.690163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 523/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:06 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:07.713280 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:07.713971 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:07.720071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:07.720553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:07.720983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:07.721666 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:07.722621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:07.723037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:07.848002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:07.855503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8c20fa49-68b6-4cb7-a2b8-a4146d9e71d1 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.146954 Oct 10 17:22:07.856066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 534/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:07 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:08.879397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:08.880009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:08.886501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:08.886981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:08.887412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:08.888127 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:08.888580 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:08.888999 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:09.021832 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:09.029571 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3be827df-137d-4baa-9f9a-9ae4d8ca6d39 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.154691 Oct 10 17:22:09.030140 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 524/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:08 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:10.052466 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:10.053072 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:10.059325 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:10.059802 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:10.060275 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:10.060952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:10.061398 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:10.061816 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:10.192598 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:10.200115 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fe029d93-e5e7-4291-b79b-de81ad6f8de8 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.151722 Oct 10 17:22:10.200664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 535/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:10 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:11.115802 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ec43b4-8b60-44e3-8060-4b40773e8bf5", "name": "network-vif-plugged", "status": "completed", "tag": "f3d981b0-c33f-458a-b1f6-0c94193f922e"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:22:11.125581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:11.126053 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:11.126478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:11.137220 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] Creating event network-vif-plugged:f3d981b0-c33f-458a-b1f6-0c94193f922e for instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 on hv-cinder-83454 Oct 10 17:22:11.142412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-a5b78b3a-eec9-4218-8931-1039f3cf4bc6 req-033eb033-ec1e-4bf5-a56c-7368febd477a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Oct 10 17:22:11.142988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 525/1060] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:22:11.224269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:11.224875 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:11.231095 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:11.231604 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:11.232057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:11.232739 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:11.233188 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:11.233609 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:11.362548 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:11.370508 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c662c29c-184a-4db6-906f-7f7fa83758a0 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.150718 Oct 10 17:22:11.371082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 536/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:11 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:12.394217 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:12.394943 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:12.396890 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:12.397539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:12.403177 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:12.403657 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:12.404119 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:12.404808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:12.405275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:12.405683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:12.535349 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:12.544326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1060dee3-45bc-4f32-90bc-e618d379a891 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1313 microversion: 2.1 time: 0.154328 Oct 10 17:22:12.544908 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 526/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:12 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:13.568528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:13.569046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:13.570947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:13.572050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:13.576689 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:13.577180 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:13.577611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:13.578284 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:13.578992 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:13.579481 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:13.581978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=81 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:13.709210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:13.716845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c3508665-1a2e-402c-a23a-b4a9cca9a40d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1498 microversion: 2.1 time: 0.152899 Oct 10 17:22:13.717401 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 537/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:13 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:14.526360 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:14.526901 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:14.533462 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:14.533937 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:14.534397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:14.535077 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:14.535524 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:14.535938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:14.560497 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Going to try to terminate instance {{(pid=119264) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:22:14.588383 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:14.844799 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ceaa25e1-bfbb-4834-9fa1-2dfa1b62a39e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "DELETE /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 204 len: 0 microversion: 2.1 time: 0.322025 Oct 10 17:22:14.845397 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 527/1064] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:22:14 2022] DELETE /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:22:14.853667 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:14.854283 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:14.861288 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:14.861775 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:14.862203 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:14.863409 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:14.863859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:14.864323 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:14.994981 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:15.002641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b7a0276a-e143-4086-87ea-92efeaaffd3e tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1504 microversion: 2.1 time: 0.152813 Oct 10 17:22:15.003801 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 538/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:14 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:16.026613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:16.027234 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:16.029668 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:22:16.034291 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:16.034769 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:16.035202 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:16.035933 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:16.036408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:16.056190 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:16.164622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:16.172488 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-cf87c2d9-de6c-49f0-aaa5-b4c689d8c7d5 tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1504 microversion: 2.1 time: 0.150088 Oct 10 17:22:16.173065 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 528/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:16 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:17.076038 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ec43b4-8b60-44e3-8060-4b40773e8bf5", "name": "network-vif-deleted", "tag": "f3d981b0-c33f-458a-b1f6-0c94193f922e"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:22:17.085854 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:17.086327 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:17.086755 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:17.097938 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] Creating event network-vif-deleted:f3d981b0-c33f-458a-b1f6-0c94193f922e for instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 on hv-cinder-83454 Oct 10 17:22:17.102928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-5992bd45-eacb-4507-9c38-105e6932d471 req-58d61bb7-af71-4774-9b1c-8ad8c5792bba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 Oct 10 17:22:17.103561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 539/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:22:17.195591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:17.196307 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:17.202720 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:17.205547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:17.205547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:17.205547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:17.205547 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:17.205966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:17.266945 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b63724faba746b5b4df8bba23c08948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9888d15cc64842d397087e5c5265ca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:22:17.275130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-3135d78d-e074-47d1-a220-97f3d07f080d tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 200 len: 1462 microversion: 2.1 time: 0.083468 Oct 10 17:22:17.277307 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 529/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:17 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:22:18.299630 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:22:18.300394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] [instance: 16ec43b4-8b60-44e3-8060-4b40773e8bf5] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:22:18.306605 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:18.307083 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:18.307512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:18.308221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:22:18.308668 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:22:18.309088 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:22:18.324205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] HTTP exception thrown: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Request method failure captured: Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 HTTP/1.1 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFSkbdsVzzZ5g2Az4e-uYSWa7G3na-AGzxBP5yqotKvkRdrXDbH6RqRfpIzB0hywKfQm5yNvw4tTuN9DJpyRNH4Iec0d1QIECIQdJR2PQ_YvSkFX_XxIyYVvtFr8N5WgqZHgnI6e8wCvGUEYhxDagnyTEv_CLRUmMPcDdChewBS_T3g Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: 9888d15cc64842d397087e5c5265ca64 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-VolumesActionsTest-597891420 Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:22:18.326608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9888d15cc64842d397087e5c5265ca64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9888d15cc64842d397087e5c5265ca64"}]}] Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-VolumesActionsTest-597891420 Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: 9888d15cc64842d397087e5c5265ca64 Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-VolumesActionsTest-597891420 Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-VolumesActionsTest-597891420-project Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: 9b63724faba746b5b4df8bba23c08948 Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-VolumesActionsTest-597891420-project Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. Oct 10 17:22:18.328421 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': '16ec43b4-8b60-44e3-8060-4b40773e8bf5'} Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:22:18.329733 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. Oct 10 17:22:18.331964 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:22:18.333519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] Returning 404 to user: Instance 16ec43b4-8b60-44e3-8060-4b40773e8bf5 could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:22:18.333519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-361ad071-9f20-4580-b208-6371127698bc tempest-VolumesActionsTest-597891420 tempest-VolumesActionsTest-597891420-project] 10.222.0.42 "GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5" status: 404 len: 111 microversion: 2.1 time: 0.032866 Oct 10 17:22:18.333519 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 540/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:22:18 2022] GET /compute/v2.1/servers/16ec43b4-8b60-44e3-8060-4b40773e8bf5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:23:00.593058 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-648688224", "imageRef": "d9bde221-8825-49f0-811c-0a6dbd795d0a", "flavorRef": "452"}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:00.600133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:00.600791 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:00.645912 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] validate_networks() for None {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:23:00.909283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:23:00.909710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:23:00.910182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:23:00.910590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:23:00.911000 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:23:00.919796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:00.920305 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:00.920738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:00.921464 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:00.921917 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:00.922339 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:00.938590 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Getting quotas for project b842bf06af7b40c987dbc83f387e7174. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:23:00.942512 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Getting quotas for user 7aa5a5c47d1e4913b7145c4f18a908f9 and project b842bf06af7b40c987dbc83f387e7174. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:23:00.958095 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:23:00.960633 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d9bde221-8825-49f0-811c-0a6dbd795d0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:23:01.119018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a07d7b81-2ae1-44a6-82f9-5735372a8e6a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529931 Oct 10 17:23:01.119673 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 530/1070] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:23:01.130859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-fc87f913-36ab-4973-8d84-a56120ee4a64 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:01.134382 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-fc87f913-36ab-4973-8d84-a56120ee4a64 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:01.134978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=7 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:01.135715 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=15 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:01.190148 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-fc87f913-36ab-4973-8d84-a56120ee4a64 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:01.197420 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-fc87f913-36ab-4973-8d84-a56120ee4a64 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1214 microversion: 2.1 time: 0.070542 Oct 10 17:23:01.197982 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 541/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:01 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:02.221238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:02.221897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:02.231501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:02.232528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:02.232528 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:02.233129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:02.233581 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:02.234006 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:02.293660 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:02.301453 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-b9199c2a-ad5a-424d-8750-3bc50ff8dc18 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1218 microversion: 2.1 time: 0.084142 Oct 10 17:23:02.302018 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 531/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:02 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:03.325025 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:03.325664 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:03.333792 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:03.338406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:03.338406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:03.338406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:03.338406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:03.339469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:03.434393 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:03.442059 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a74c1eda-50b3-4f3f-800c-0eed08b7c048 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1274 microversion: 2.1 time: 0.121406 Oct 10 17:23:03.442608 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 542/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:03 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:04.471247 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:04.471854 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:04.477922 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:04.478468 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:04.478904 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:04.480259 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:04.480711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:04.481130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:04.666334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:04.674174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-eea39e33-f6a6-45c2-a2ea-a6c45531931c tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.207027 Oct 10 17:23:04.674736 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 532/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:04 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:23:05.300652 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9084e201-575a-4308-8fab-a441335f3d46", "tag": "dec91948-9c9b-4480-aea4-6c18bb7a1688"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:05.312318 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:05.312791 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:05.313215 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:05.324536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] Creating event network-changed:dec91948-9c9b-4480-aea4-6c18bb7a1688 for instance 9084e201-575a-4308-8fab-a441335f3d46 on hv-cinder-83454 Oct 10 17:23:05.330374 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-f67a47fd-a0c3-43de-8feb-53ba5a9de0c8 req-b8da8237-a622-48a6-a060-c3c95a986de1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033465 Oct 10 17:23:05.330960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 543/1075] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:23:05.697818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:05.698372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:05.705107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:05.705598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:05.706035 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:05.706725 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:05.707179 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:05.707601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:05.902059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:05.909705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6eae5602-08bd-479a-a6d4-dd244b7377f8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.215842 Oct 10 17:23:05.910269 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 533/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:05 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:06.933952 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:06.934644 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:06.941151 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:06.941635 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:06.942066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:06.942746 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:06.943192 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:06.943613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:07.077415 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:07.085246 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9c7b42d3-fd15-480a-a978-b72343b211a7 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.156157 Oct 10 17:23:07.085807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 544/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:06 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:08.107899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:08.108450 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:08.114896 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:08.115408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:08.115852 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:08.116584 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:08.117040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:08.117469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:08.242636 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:08.250839 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d8da6e48-cdcb-41a0-be1e-ce7cf56a6fff tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.146897 Oct 10 17:23:08.251412 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 534/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:08 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:09.274130 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:09.274769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:09.281782 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:09.282259 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:09.282694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:09.283403 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:09.283847 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:09.284286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:09.415684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:09.423461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0de2b985-6987-48cb-9560-162871380a79 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.153186 Oct 10 17:23:09.428461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 545/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:09 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:10.447070 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:10.447690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:10.454107 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:10.454861 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:10.455298 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:10.455989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:10.456469 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:10.456898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:10.583249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:10.591356 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-d8202400-f2f1-4ff3-88a8-92ece6ae4ba8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.147687 Oct 10 17:23:10.591914 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 535/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:10 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:11.601249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9084e201-575a-4308-8fab-a441335f3d46", "name": "network-vif-plugged", "status": "completed", "tag": "dec91948-9c9b-4480-aea4-6c18bb7a1688"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:11.606872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:11.612306 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:11.612784 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:11.613217 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:11.613639 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:11.614242 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:11.616086 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:11.616741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:11.622779 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:11.623268 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:11.623726 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:11.624445 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:11.624804 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] Creating event network-vif-plugged:dec91948-9c9b-4480-aea4-6c18bb7a1688 for instance 9084e201-575a-4308-8fab-a441335f3d46 on hv-cinder-83454 Oct 10 17:23:11.624926 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:11.625309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:11.629786 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-9adf35ae-b3b3-475c-8f44-e75f8b7c6cff req-0592fb10-ff6c-4e0c-b530-54a3906d4cf3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Oct 10 17:23:11.634627 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 546/1081] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:23:11.757143 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:11.765368 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-7c86a172-4eeb-4865-b7d6-47b95f81f727 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.155715 Oct 10 17:23:11.765927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 536/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:11 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:12.789377 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:12.790080 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:12.796877 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:12.797355 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:12.797811 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:12.798498 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:12.798947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:12.799367 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:13.078269 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:13.086082 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-84e517b2-8dbb-410d-bcaf-87b771c15e7a tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1314 microversion: 2.1 time: 0.301756 Oct 10 17:23:13.087127 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 547/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:12 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:14.109886 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:14.110489 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:14.117155 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.117582 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.118019 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.118704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.119153 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.119574 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.250710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:14.258263 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6bfaab97-bd81-46ea-964e-789d6e8f9116 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1464 microversion: 2.1 time: 0.152634 Oct 10 17:23:14.258806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 537/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:14 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:14.303422 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:14.303921 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:14.310885 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.311364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.311795 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.312522 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.312973 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.313394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.338267 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:23:14.614886 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-87f25855-e34b-40de-aa97-d5f45964a2b8 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 204 len: 0 microversion: 2.1 time: 0.314985 Oct 10 17:23:14.615464 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 548/1085] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:23:14 2022] DELETE /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:23:14.624088 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:14.628149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:14.630647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.631123 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.631551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.632257 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:14.632704 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:14.633113 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:14.814342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:14.822115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-168fa7a0-b99e-4b36-a6b3-cf20e644aa1b tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1470 microversion: 2.1 time: 0.202459 Oct 10 17:23:14.822671 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 538/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:14 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:15.846230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:15.846920 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:15.853242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:15.853724 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:15.854158 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:15.854839 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:15.855288 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:15.855703 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:15.984255 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:15.991906 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1e07a424-af2a-47d8-9b5c-2a8114cf7ae6 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1470 microversion: 2.1 time: 0.149899 Oct 10 17:23:15.992490 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 549/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:15 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:23:16.852343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9084e201-575a-4308-8fab-a441335f3d46", "name": "network-vif-deleted", "tag": "dec91948-9c9b-4480-aea4-6c18bb7a1688"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:16.863096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:16.863681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:16.864237 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:16.877084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] Creating event network-vif-deleted:dec91948-9c9b-4480-aea4-6c18bb7a1688 for instance 9084e201-575a-4308-8fab-a441335f3d46 on hv-cinder-83454 Oct 10 17:23:16.882329 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-7f78d41b-1bb3-423d-8e41-49091bf3dd82 req-04f6dec7-aa2b-45ca-9a42-d8afba2cc559 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033694 Oct 10 17:23:16.883027 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 539/1088] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:23:17.015209 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:17.015766 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:17.022221 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:17.022699 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:17.023126 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:17.023845 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:17.024386 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:17.024807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:17.087713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5a5c47d1e4913b7145c4f18a908f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b842bf06af7b40c987dbc83f387e7174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:17.095465 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-01a3cf2d-131f-46a7-9f14-663d41e08ff0 tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 200 len: 1299 microversion: 2.1 time: 0.084321 Oct 10 17:23:17.096037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 550/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:17 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:23:18.119828 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:18.120551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] [instance: 9084e201-575a-4308-8fab-a441335f3d46] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:18.126665 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:18.127139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:18.127568 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:18.128278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:18.128724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:18.129139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:18.141923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.wsgi [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] HTTP exception thrown: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Request method failure captured: Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: request: GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 HTTP/1.1 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept: application/json Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Accept-Encoding: identity Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Connection: close Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Length: 0 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Content-Type: application/json Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Host: 10.222.0.42 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Openstack-System-Scope: None Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: User-Agent: python-urllib3/1.26.12 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Auth-Token: gAAAAABjRFTyhuz07AwGz970afI2XGXyldHbXKXnUdQVKN-h30zDe6a7v1fAuoSYV9isvpCsd_B_22c9AEVYVWeg5c7_PvKNjTjgUwH4q9Sjq9q3-PugGX0qyCKTLtzMeunPHTOua2KptvqE7gR3NN_WrhVzN_8TV2QW8zNaalV1CM7OkY_RT1Y Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Id: None Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Domain-Name: None Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Identity-Status: Confirmed Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Is-Admin-Project: True Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Id: default Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Domain-Name: Default Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Id: b842bf06af7b40c987dbc83f387e7174 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Project-Name: tempest-VolumesNegativeTest-100619832 Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Role: reader,member Oct 10 17:23:18.143498 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Roles: reader,member Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b842bf06af7b40c987dbc83f387e7174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b842bf06af7b40c987dbc83f387e7174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b842bf06af7b40c987dbc83f387e7174"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b842bf06af7b40c987dbc83f387e7174"}]}] Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant: tempest-VolumesNegativeTest-100619832 Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Id: b842bf06af7b40c987dbc83f387e7174 Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-Tenant-Name: tempest-VolumesNegativeTest-100619832 Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User: tempest-VolumesNegativeTest-100619832-project Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Id: default Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Domain-Name: Default Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Id: 7aa5a5c47d1e4913b7145c4f18a908f9 Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: X-User-Name: tempest-VolumesNegativeTest-100619832-project Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: method: > Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: exception: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. Oct 10 17:23:18.145352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: action_args: {'id': '9084e201-575a-4308-8fab-a441335f3d46'} Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:23:18.146516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. Oct 10 17:23:18.148174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR nova.api.openstack.wsgi Oct 10 17:23:18.150047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] Returning 404 to user: Instance 9084e201-575a-4308-8fab-a441335f3d46 could not be found. {{(pid=119264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:23:18.150047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-22b1b8da-cbb5-4f2b-bbde-8b9f5d4e80fa tempest-VolumesNegativeTest-100619832 tempest-VolumesNegativeTest-100619832-project] 10.222.0.42 "GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46" status: 404 len: 111 microversion: 2.1 time: 0.029765 Oct 10 17:23:18.150047 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 540/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:18 2022] GET /compute/v2.1/servers/9084e201-575a-4308-8fab-a441335f3d46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:23:35.960380 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:35.961146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:36.120128 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-135e7832-d3c9-4dfb-ac8e-e8033aba4f81 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Action: 'create', calling method: .version_select at 0x7f34ef201790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1236472072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEsgwIb8ikgxHkN0CL/vXPX8+W6JZDEW0f2MLbApITCvV/g+K8D+OHC/rLMvTcXjTYAznjdz9z/WPTiDFCnCChySezajOnviblMJ6LuvVXmhgL5v0jlC7nFhHYxmfJacQ=="}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:36.135651 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-135e7832-d3c9-4dfb-ac8e-e8033aba4f81 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Getting quotas for project be063f15b64a45598299aacd0a40e9e8. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:23:36.140004 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.quota [None req-135e7832-d3c9-4dfb-ac8e-e8033aba4f81 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Getting quotas for user b6576097fd29427dbada288b767be922 and project be063f15b64a45598299aacd0a40e9e8. Resources: {'key_pairs'} {{(pid=119263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:23:36.227321 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-135e7832-d3c9-4dfb-ac8e-e8033aba4f81 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.272709 Oct 10 17:23:36.227954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 551/1091] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 10 17:23:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:23:56.330866 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1410667974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1236472072", "security_groups": [{"name": "tempest-secgroup-smoke-491808532"}], "networks": [{"uuid": "1aa97eba-7893-4510-8e53-561fccf49281"}], "block_device_mapping_v2": [{"uuid": "2de7fd08-0a7d-4b2e-9d7a-8d7a771aa270", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:23:56.341240 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:23:56.341402 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 10 17:23:56.342989 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:56.343681 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=54 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:56.457007 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.network.neutron [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] validate_networks() for [('1aa97eba-7893-4510-8e53-561fccf49281', None, None, None, None, None)] {{(pid=119264) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 17:23:56.811451 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Flavor limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 17:23:56.811812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Image limits 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 17:23:56.812323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Flavor pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 17:23:56.812729 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Image pref 0:0:0 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 17:23:56.813130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.virt.hardware [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119264) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 17:23:56.822493 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:56.822970 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:56.823399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:56.824144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:56.824591 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:56.825005 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:56.842238 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Getting quotas for project be063f15b64a45598299aacd0a40e9e8. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 17:23:56.846831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.quota [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Getting quotas for user b6576097fd29427dbada288b767be922 and project be063f15b64a45598299aacd0a40e9e8. Resources: {'cores', 'ram', 'instances'} {{(pid=119264) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 17:23:56.903059 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Going to run 1 instances... {{(pid=119264) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 17:23:56.905226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2de7fd08-0a7d-4b2e-9d7a-8d7a771aa270',volume_size=None,volume_type=None)] {{(pid=119264) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 17:23:57.312785 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-56523f34-61ad-481c-af8e-cf6048827fd5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986866 Oct 10 17:23:57.313413 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 541/1092] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 10 17:23:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 17:23:57.322433 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=4 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:57.323196 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:23:57.327116 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b102e95a-9759-484b-a16d-4d87b0c6cb74 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:57.327752 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b102e95a-9759-484b-a16d-4d87b0c6cb74 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:57.385304 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-b102e95a-9759-484b-a16d-4d87b0c6cb74 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:57.392352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b102e95a-9759-484b-a16d-4d87b0c6cb74 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1089 microversion: 2.1 time: 0.071224 Oct 10 17:23:57.392919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 552/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:57 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:58.415646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:58.416275 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:58.423118 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:58.423598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:58.424046 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:58.424738 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:58.425186 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:58.425607 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:58.485147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:58.493010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-731fd98e-417b-4ce7-9498-08d5871e0e07 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1139 microversion: 2.1 time: 0.081819 Oct 10 17:23:58.493553 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 542/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:58 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:23:59.516451 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:23:59.517491 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:23:59.524007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:59.524506 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:59.524941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:59.525625 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:23:59.526074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:23:59.526495 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:23:59.587176 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:23:59.594878 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f9d4489c-2464-493a-b5b7-603da63ce995 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1187 microversion: 2.1 time: 0.082796 Oct 10 17:23:59.595995 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 553/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:23:59 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:00.618286 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:00.618883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:00.625789 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:00.625994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:00.627195 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:00.627898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:00.628401 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:00.628825 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:00.783684 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:00.793334 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f77fba40-b947-43cd-bd7e-e39608bdad1e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1272 microversion: 2.1 time: 0.178896 Oct 10 17:24:00.794380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 543/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:00 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:01.818305 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:01.818904 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:01.825418 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:01.825903 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:01.826983 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:01.827129 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:01.827560 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:01.827984 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:01.906988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:24:01.917144 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:01.917630 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:01.918056 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:01.931735 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] Creating event network-changed:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:24:01.937449 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-c8187a80-6050-4f8a-a825-f633624975ae req-7de2c7ca-d332-49c2-b386-a0482cfd5940 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Oct 10 17:24:01.938408 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 544/1097] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:24:02.038934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:02.046793 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0df9134a-4234-4191-8ec6-909bfe6600bf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.232875 Oct 10 17:24:02.047349 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 554/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:01 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:03.071303 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:03.071944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:03.078533 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:03.079009 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:03.080321 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:03.081003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:03.081458 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:03.081877 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:03.211862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:03.219607 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-012b7b52-008d-4bbb-9e60-045c25ce9b9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.152530 Oct 10 17:24:03.220246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 545/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:03 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:04.241965 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:04.242597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:04.249600 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:04.250086 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:04.250550 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:04.251898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:04.252406 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:04.252834 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:04.383228 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:04.390959 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d90a5b74-ca34-49d1-80ef-7a0ee7360d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.152864 Oct 10 17:24:04.391513 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 555/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:04 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:05.413905 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:05.414516 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:05.420601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:05.421076 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:05.421507 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:05.422182 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:05.422629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:05.423045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:05.552741 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:05.560287 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8f3b686c-2099-459c-bb40-1fb5d6958ed5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.150290 Oct 10 17:24:05.560841 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 546/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:05 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:06.583650 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:06.584286 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:06.590813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:06.591303 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:06.591735 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:06.592454 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:06.592909 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:06.593335 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:06.721081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:06.728761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9eba5b68-31cf-4cdc-aba0-eafd1b97b870 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.149283 Oct 10 17:24:06.729322 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 556/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:06 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:07.752643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:07.753248 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:07.755711 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=2 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:24:07.756394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell0:SELECT=6 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:24:07.761141 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:07.764292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:07.764292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:07.764292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:07.764292 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:07.764699 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:07.895253 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:07.902774 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-a48843c5-572e-4205-b3d2-7ff809555ff1 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.154640 Oct 10 17:24:07.903332 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 547/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:07 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:08.925394 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:08.925996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:08.927835 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell0:SELECT=2 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:24:08.933134 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:08.933611 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:08.934042 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:08.934718 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:08.935164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:08.935584 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:09.065461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:09.073053 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-23ea5061-bd1e-4074-a36d-1a3c75220d11 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.151582 Oct 10 17:24:09.073613 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 557/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:08 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:10.097207 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:10.097819 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:10.104224 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:10.104710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:10.105145 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:10.105837 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:10.106283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:10.106710 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:10.237659 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:10.245243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-477fd1b7-3b30-4674-87d6-48ef6d39efb4 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.152557 Oct 10 17:24:10.245808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 548/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:10 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:11.268055 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:11.268657 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:11.275022 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:11.275503 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:11.275935 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:11.276645 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:11.277093 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:11.277511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:11.405918 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:11.414091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-c3a5c246-f329-4a90-a506-1b5620ee77ad tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.150015 Oct 10 17:24:11.414694 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 558/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:11 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:12.437431 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:12.438039 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:12.444978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:12.445458 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:12.445888 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:12.446602 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:12.447049 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:12.447472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:12.573417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:12.581352 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-8bb12f27-268d-4305-a763-3f0d84e29913 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.147804 Oct 10 17:24:12.581923 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 549/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:12 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:13.603205 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:13.603815 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:13.610295 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:13.611108 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:13.611388 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:13.611868 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:13.612343 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:13.612765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:13.749285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:13.757692 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-555c2728-03ed-4665-ba6d-faf0a07dab55 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.158330 Oct 10 17:24:13.758383 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 559/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:13 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:13.770174 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "name": "network-vif-plugged", "status": "completed", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:24:13.780230 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:13.780694 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:13.781130 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:13.791617 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] Creating event network-vif-plugged:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:24:13.796620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-58eb1474-d775-4375-a1bb-c138586cfb61 req-b82de271-c28a-4758-aef0-fc0fd108b23d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030469 Oct 10 17:24:13.797225 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 550/1109] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:24:14.780261 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:14.780872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:14.787285 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:14.787761 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:14.788218 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:14.788896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:14.789339 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:14.789753 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:14.931452 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:14.939057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-13246e5d-8456-4a7d-b490-40e338428178 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1260 microversion: 2.1 time: 0.162688 Oct 10 17:24:14.939614 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 560/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:14 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:15.963437 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:15.964154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:15.970891 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:15.971367 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:15.971816 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:15.972549 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:15.972994 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:15.973409 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:16.100796 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:16.108440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-cd2b9891-1a5a-45e9-a9ca-dbe4fc17e463 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1444 microversion: 2.1 time: 0.149961 Oct 10 17:24:16.109003 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 551/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:15 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:16.130436 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:24:16.131026 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:24:16.137333 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:16.137813 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:16.138249 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:16.138928 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:16.139376 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:16.139790 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:16.269663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:24:16.277297 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-a536160e-ee24-43c1-971b-537b5367a676 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1444 microversion: 2.1 time: 0.150784 Oct 10 17:24:16.277859 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 561/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:24:16 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:24:18.152517 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:24:18.162601 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:24:18.163076 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:24:18.163532 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:24:18.174278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] Creating event network-changed:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:24:18.179375 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-81a90ac9-3ba5-4c73-b3ff-96035c1fef2f req-778f7d48-5661-410b-9ed4-2a7739157051 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Oct 10 17:24:18.179971 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 552/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:26:15.562074 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=22 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:15.562805 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=54 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:15.563559 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:26:15.563707 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Mon Oct 10 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action (ip 10.222.0.42) !!! Oct 10 17:26:15.565141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:26:15.565262 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Mon Oct 10 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action (ip 10.222.0.42) !!! Oct 10 17:26:15.566934 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 17:26:15.567049 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Mon Oct 10 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action (ip 10.222.0.42) !!! Oct 10 17:26:15.571528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:26:15.572070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:15.584299 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:15.584812 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:15.585251 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:15.585943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:15.586399 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:15.586822 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:15.613830 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.objects.instance [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lazy-loading 'flavor' on Instance uuid a8212218-fa5a-49e4-8e73-7e83e886e2bd {{(pid=119263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:26:15.858639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-d108a9f4-5165-4390-b102-9cfbf2b7f0dd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "POST /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action" status: 202 len: 0 microversion: 2.1 time: 0.297982 Oct 10 17:26:15.859141 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 562/1114] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:26:15 2022] POST /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 17:26:15.871376 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2cd1b999-9963-426d-bd77-b3cd7c712503] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 10 17:26:15.872010 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:15.872860 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=56 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:15.874980 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 17:26:15.874980 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd (ip 10.222.0.42) !!! Oct 10 17:26:15.879565 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:15.880357 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:15.888050 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:15.888534 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:15.888965 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:15.889646 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:15.890089 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:15.890503 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:16.027163 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:16.035634 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-69bd2745-458b-406c-8c00-415fde621a5f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.171733 Oct 10 17:26:16.036821 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 553/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:15 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:17.062681 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:17.063288 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:17.069366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:17.069844 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:17.070273 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:17.070947 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:17.071391 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:17.071807 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:17.203907 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:17.211941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-78470d8b-e660-48fc-85da-6294f0fc960b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.154159 Oct 10 17:26:17.212545 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 563/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:17 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:18.235501 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:18.236131 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:18.245818 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:18.246541 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:18.246973 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:18.247673 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:18.248187 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:18.248610 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:18.254193 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] [2cd1b999-9963-426d-bd77-b3cd7c712503] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 58192. Oct 10 17:26:18.378025 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:18.386399 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-08778cdc-d430-40b6-b31d-97873ddcfa23 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.154802 Oct 10 17:26:18.386966 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 554/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:18 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:19.408437 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:19.409064 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:19.415423 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:19.415898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:19.416358 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:19.417037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:19.417480 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:19.417892 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:19.547691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:19.555364 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-0b21d807-673c-4f0e-9686-c546a9da9a27 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.150856 Oct 10 17:26:19.555921 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 564/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:19 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:20.578797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:20.579394 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:20.586613 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:20.587099 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:20.587560 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:20.588278 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:20.588734 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:20.589158 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:20.716724 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:20.724981 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f2691742-0c27-400f-b1d9-df166f1310b8 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.150136 Oct 10 17:26:20.725551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 555/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:20 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:21.748131 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:21.748757 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:21.755071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:21.755545 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:21.755975 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:21.756678 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:21.757122 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:21.757538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:21.889919 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:21.898238 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-2f2bf55e-faae-4f88-8c34-00d6923f9b83 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.154058 Oct 10 17:26:21.898796 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 565/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:21 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:22.921924 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:22.922536 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:22.929418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:22.929898 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:22.930331 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:22.931021 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:22.931473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:22.931893 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:23.060476 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:23.068129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-5d96d8af-736c-4e9f-81c0-539072390ef7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.150056 Oct 10 17:26:23.068693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 556/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:22 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:24.090726 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:24.091338 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:24.098046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:24.098542 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:24.098979 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:24.099670 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:24.100164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:24.100588 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:24.228607 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:24.236351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-beeb7a3e-a73f-46d6-82f3-3ced39ec8c7d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.149496 Oct 10 17:26:24.236905 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 566/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:24 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:25.260663 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:25.261254 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:25.267647 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:25.268161 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:25.268594 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:25.269283 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:25.269733 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:25.270157 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:25.402054 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:25.409850 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0d29ea0c-2d3e-4c30-bd56-8f83a895f447 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.153022 Oct 10 17:26:25.410415 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 557/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:25 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:26.433224 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:26.433829 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:26.439941 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:26.440459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:26.440890 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:26.441597 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:26.442045 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:26.442462 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:26.630902 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:26.638612 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-94a52d9d-e3cb-4628-ad4b-56b0600088b5 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.209514 Oct 10 17:26:26.639175 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 567/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:26 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:27.662763 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:27.663358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:27.669862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:27.670342 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:27.670776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:27.671455 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:27.671932 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:27.672382 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:27.802148 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:27.809787 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6a771ad9-ff82-455b-ac48-2ecd15aeef50 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.151424 Oct 10 17:26:27.810355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 558/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:27 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:28.832943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:28.833539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:28.839932 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:28.840443 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:28.840876 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:28.841558 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:28.842008 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:28.842429 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:28.977538 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:28.980012 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-04deb8fb-9223-41dc-99e2-71bd8a86b5d6 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.151157 Oct 10 17:26:28.980595 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 568/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:28 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:30.004267 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:30.005322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:30.011902 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:30.015675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:30.015675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:30.015675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:30.015675 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:30.016115 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:30.213620 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:30.221323 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-2feecffe-631c-4d7f-a3b3-bc0a44f09b7c tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.221086 Oct 10 17:26:30.225705 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 559/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:29 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:31.244095 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:31.244713 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:31.251071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.251553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.251986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.252691 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.253138 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.253561 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.380556 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:31.388502 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-34755553-8311-4d5d-bdd1-86728f0e1fb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1510 microversion: 2.1 time: 0.148305 Oct 10 17:26:31.389054 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 569/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:31 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:31.411473 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:26:31.412084 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:31.418435 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.418911 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.419340 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.420012 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.420478 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.420894 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.460430 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119264) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 17:26:31.749806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-0f89cb47-685f-494e-b2e1-5301a9e2a2b9 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "POST /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action" status: 202 len: 0 microversion: 2.1 time: 0.342198 Oct 10 17:26:31.750622 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 560/1129] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 10 17:26:31 2022] POST /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 17:26:31.758631 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:31.759243 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:31.765463 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.765954 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.766390 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.767081 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:31.767571 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:31.767996 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:31.900164 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:31.908216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-75ec93bf-a707-47ef-8567-f281b9e6d422 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1518 microversion: 2.1 time: 0.153539 Oct 10 17:26:31.908781 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 570/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:31 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:32.324149 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "name": "network-vif-unplugged", "status": "completed", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:26:32.334614 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:32.334819 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:32.335249 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:32.346771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.compute.server_external_events [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] Unable to find a host for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd. Dropping event network-vif-unplugged {{(pid=119264) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 17:26:32.352509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-2464518b-5caa-441e-9496-969a7122bf85 req-2f061108-ff64-4fb4-9e0e-824c593542a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088640 Oct 10 17:26:32.352509 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 561/1131] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 17:26:32.932361 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:32.933007 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:32.939536 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:32.940035 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:32.940469 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:32.941146 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:32.941639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:32.942057 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:33.071590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:33.079458 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-f7ea41eb-3dcd-4371-996d-27205ec3600f tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1518 microversion: 2.1 time: 0.151047 Oct 10 17:26:33.083511 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 571/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:32 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:34.103197 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:34.103797 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:34.110648 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:34.111129 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:34.111562 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:34.112308 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:34.112754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:34.113178 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:34.245170 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:34.253085 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-dfe45b0e-b98a-4dd1-8e52-e70782f47754 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1520 microversion: 2.1 time: 0.153831 Oct 10 17:26:34.253776 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 562/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:34 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:35.280528 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:35.281230 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:35.288152 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:35.288639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:35.289076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:35.289769 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:35.290227 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:35.290646 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:35.483762 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:35.492050 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-6b1a12bc-fa44-442d-8428-a896306f79cc tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.215450 Oct 10 17:26:35.492621 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 572/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:35 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:36.515243 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:36.515883 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:36.522326 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:36.523050 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:36.523475 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:36.524191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:36.524669 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:36.528440 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:36.658842 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:36.667052 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-29dad6ae-b7c7-4eb8-b7cf-b47242cf6f0b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.155790 Oct 10 17:26:36.667764 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 563/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:36 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:37.690943 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:37.691579 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:37.698068 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:37.698546 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:37.698986 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:37.699673 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:37.700160 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:37.700586 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:37.826076 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:37.834539 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-27682e9a-716f-433c-8e91-6fd39af38113 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.147512 Oct 10 17:26:37.835091 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 573/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:37 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:38.858210 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:38.858817 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:38.866026 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:38.866511 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:38.866948 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:38.867643 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:38.868119 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:38.868545 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:38.997390 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:39.004995 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-9ac1eac8-178c-4bb7-b72c-471395ff161d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.150688 Oct 10 17:26:39.005559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 564/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:38 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:40.027242 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:40.027853 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:40.034402 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:40.034898 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:40.035341 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:40.036641 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:40.037096 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:40.037518 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:40.167974 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:40.178663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bc5a254f-adfc-4a51-aa57-0690d02a7816 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.152373 Oct 10 17:26:40.178663 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 574/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:40 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:41.199258 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:41.200685 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:41.206380 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:41.207117 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:41.208200 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:41.208882 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:41.209358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:41.209786 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:41.338683 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:41.346379 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ecec1849-7937-4741-94d4-aec03e472639 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.151135 Oct 10 17:26:41.346944 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 565/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:41 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:42.369071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:42.369680 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:42.376410 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:42.376891 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:42.377319 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:42.378002 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:42.378447 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:42.378862 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:42.510449 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:42.518213 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-8a40bc75-30b1-4a8b-b197-03752c4cfd0e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.153258 Oct 10 17:26:42.518923 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 575/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:42 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:43.542693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:43.543322 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:43.549698 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:43.550191 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:43.550716 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:43.552133 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:43.552572 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:43.552988 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:43.679589 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:43.687246 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-e9e42aa3-f887-44ee-a7a0-fcbf61613076 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.148446 Oct 10 17:26:43.687806 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 566/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:43 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:44.711070 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:44.711678 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:44.718085 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:44.718566 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:44.719001 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:44.719684 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:44.720165 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:44.720588 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:44.739500 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:44.853872 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:44.861873 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-3f5c2e6b-9284-4938-86f8-1f7c87b5358e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.155448 Oct 10 17:26:44.869332 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 576/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:44 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:45.884690 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:45.885284 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:45.891831 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:45.897042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:45.897042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:45.897042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:45.897042 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:45.897497 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:46.023147 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:46.025319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:46.031385 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6307d5ed-9fba-4618-9868-9b0329a2e2f7 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.150625 Oct 10 17:26:46.039348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 567/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:45 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:46.424686 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "name": "network-vif-plugged", "status": "completed", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:26:46.432144 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=31 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:46.436468 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:46.436940 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:46.437366 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:46.448512 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] Creating event network-vif-plugged:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:26:46.453525 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-b44aed52-587d-4260-8db6-3fc86945f85f req-4261fefb-5006-4c1b-a717-04bb233e4a05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Oct 10 17:26:46.454093 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 577/1144] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:26:47.054651 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:47.055270 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:47.057910 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:26:47.062826 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:47.063313 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:47.063754 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:47.064471 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:47.064927 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:47.065349 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:47.194150 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:47.201808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-ad7d1be0-9980-4331-af32-30c78a635f30 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.151070 Oct 10 17:26:47.202372 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 568/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:47 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:48.228683 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:48.229375 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:48.236195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:48.236679 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:48.237110 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:48.237794 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:48.238308 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:48.238760 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:48.390351 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:48.399602 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-9ed81ba7-140f-427e-a7ee-56216bc16a1b tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1576 microversion: 2.1 time: 0.176970 Oct 10 17:26:48.400206 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 578/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:48 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:26:49.423559 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:26:49.424209 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:26:49.431096 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:49.431580 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:49.432062 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:49.432748 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:26:49.433226 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:26:49.433649 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:26:49.561693 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:26:49.569318 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f1625d82-edb2-4a70-8ddd-ddc41f5d7bb0 tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1563 microversion: 2.1 time: 0.149652 Oct 10 17:26:49.569881 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 569/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:26:49 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:28:06.029933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_api:SELECT=3 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:28:06.029933 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG dbcounter [-] [119263] Writing DB stats nova_cell1:SELECT=10 {{(pid=119263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:28:06.032993 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_api:SELECT=3 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:28:06.034214 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG dbcounter [-] [119264] Writing DB stats nova_cell1:SELECT=13 {{(pid=119264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:28:06.035154 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:28:06.035355 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 10 17:28:06.036539 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 17:28:06.036747 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: Mon Oct 10 17:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 10 17:28:06.040701 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:06.041352 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:06.057347 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:06.057846 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:06.058279 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:06.058978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:06.060326 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:06.060750 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:06.091071 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Going to try to terminate instance {{(pid=119263) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 17:28:06.120808 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:28:06.131812 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:06.132330 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:06.132760 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:06.145026 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.compute.server_external_events [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] Creating event network-changed:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:28:06.151343 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [req-7b280cb2-d9f2-4380-ad1c-ed99a02c4bb6 req-e29a4ad3-10bf-41fa-9ac5-b428cc3aa236 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120190 Oct 10 17:28:06.152444 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 570/1148] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 17:28:06.401066 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-b65551d5-8284-4acc-b20a-298184d6980e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 204 len: 0 microversion: 2.1 time: 0.377553 Oct 10 17:28:06.401698 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 579/1149] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 10 17:28:06 2022] DELETE /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 17:28:06.411236 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:06.413319 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:06.421629 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:06.422120 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:06.422551 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:06.423316 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:06.423770 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:06.424251 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:06.678500 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:28:06.686192 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-6e878f60-20fc-4232-9aed-c4bfda86cbdf tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.279859 Oct 10 17:28:06.686771 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 571/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:28:06 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 17:28:07.710461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:07.711153 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:07.717731 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:07.718210 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:07.718639 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:07.719320 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:07.719765 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:07.720216 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:07.915414 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.policy [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119263) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:28:07.923011 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-1fb97f66-21e8-4680-806a-7205ef01fa7e tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1569 microversion: 2.1 time: 0.217120 Oct 10 17:28:07.923567 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 580/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:28:07 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:28:08.947227 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:08.947838 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:08.954480 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:08.954978 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:08.955417 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:08.956139 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:08.956598 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:08.957024 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:09.025461 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212218-fa5a-49e4-8e73-7e83e886e2bd", "name": "network-vif-deleted", "tag": "57c4a8b9-69e2-4476-b049-3e16e3253025"}]} {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 17:28:09.025949 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:28:09.033358 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-f424b470-378d-440e-b86d-c0152d5ea4da tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1383 microversion: 2.1 time: 0.090532 Oct 10 17:28:09.033960 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:09.034079 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 572/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:28:08 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1383 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:28:09.034430 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:09.034855 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:09.046475 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.compute.server_external_events [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] Creating event network-vif-deleted:57c4a8b9-69e2-4476-b049-3e16e3253025 for instance a8212218-fa5a-49e4-8e73-7e83e886e2bd on hv-cinder-83454 Oct 10 17:28:09.053195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [req-8b293dbb-9a30-4ca0-97f2-f27b8a1398e9 req-0ba68e05-dd60-4eee-ba9b-ff876e86c2ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085844 Oct 10 17:28:09.053195 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 581/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 10 17:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 17:28:10.057040 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:10.057897 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.compute.api [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119264) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:10.064418 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:10.064899 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:10.065769 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:10.066615 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:10.067348 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:10.067798 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:10.104938 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:10.105422 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:10.105862 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG oslo_concurrency.lockutils [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:10.106309 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.objects.instance [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lazy-loading 'fault' on Instance uuid a8212218-fa5a-49e4-8e73-7e83e886e2bd {{(pid=119264) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 17:28:10.145472 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.policy [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6576097fd29427dbada288b767be922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be063f15b64a45598299aacd0a40e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119264) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 17:28:10.153744 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-1313b0bd-c868-4acc-bec6-43375b3bef9d tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 200 len: 1225 microversion: 2.1 time: 0.100849 Oct 10 17:28:10.154304 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 573/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:28:10 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 17:28:11.178123 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '>' {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:11.178824 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.compute.api [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] [instance: a8212218-fa5a-49e4-8e73-7e83e886e2bd] Fetching instance by UUID {{(pid=119263) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 17:28:11.184978 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:11.185459 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:11.185905 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:11.186590 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Acquiring lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 17:28:11.187046 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 17:28:11.187471 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG oslo_concurrency.lockutils [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Lock "e4faa300-58d0-4d9b-bfd7-9b3182920878" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 17:28:11.200441 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.wsgi [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] HTTP exception thrown: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Request method failure captured: Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: request: GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd HTTP/1.1 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept: application/json Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Accept-Encoding: identity Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Connection: close Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Length: 0 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Content-Type: application/json Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Host: 10.222.0.42 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: Openstack-System-Scope: None Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: User-Agent: python-urllib3/1.26.12 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Auth-Token: gAAAAABjRFUR9x3mwnLXWU0HJJT95Eag8YmiF3Q_ZJxUrlR-WghFuLiRDSqooBZ5Z8tmsmJ1SSNwvOakv8V-aoNj3_mqWMa5BOnhuCnN3TpuIv_z3rRJUTedq3JtC35_AThQDFKb8Gz4A4O24OPZjFeiRzrTE05e8y7IHdH-2TMNaVFjc9a73b0 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Id: None Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Domain-Name: None Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Identity-Status: Confirmed Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Is-Admin-Project: True Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Id: default Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Domain-Name: Default Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Id: be063f15b64a45598299aacd0a40e9e8 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Project-Name: tempest-TestShelveInstance-258778408 Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Role: reader,member Oct 10 17:28:11.202037 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Roles: reader,member Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be063f15b64a45598299aacd0a40e9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be063f15b64a45598299aacd0a40e9e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be063f15b64a45598299aacd0a40e9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be063f15b64a45598299aacd0a40e9e8"}]}] Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant: tempest-TestShelveInstance-258778408 Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Id: be063f15b64a45598299aacd0a40e9e8 Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-Tenant-Name: tempest-TestShelveInstance-258778408 Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User: tempest-TestShelveInstance-258778408-project Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Id: default Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Domain-Name: Default Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Id: b6576097fd29427dbada288b767be922 Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: X-User-Name: tempest-TestShelveInstance-258778408-project Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: method: > Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: exception: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. Oct 10 17:28:11.203806 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: action_args: {'id': 'a8212218-fa5a-49e4-8e73-7e83e886e2bd'} Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: {{(pid=119263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 17:28:11.204896 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. Oct 10 17:28:11.206553 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: ERROR nova.api.openstack.wsgi Oct 10 17:28:11.208541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: DEBUG nova.api.openstack.wsgi [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Returning 404 to user: Instance a8212218-fa5a-49e4-8e73-7e83e886e2bd could not be found. {{(pid=119263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 17:28:11.208541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: INFO nova.api.openstack.requestlog [None req-bb1fb917-78e3-4644-93d6-5b6817e937ed tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd" status: 404 len: 111 microversion: 2.1 time: 0.030684 Oct 10 17:28:11.208541 dv-cinder-834540-2-iscsi devstack@n-api.service[119263]: [pid: 119263|app: 0|req: 582/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 10 17:28:11 2022] GET /compute/v2.1/servers/a8212218-fa5a-49e4-8e73-7e83e886e2bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 17:28:11.434045 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: DEBUG nova.api.openstack.wsgi [None req-685f66b5-f6a0-4b14-a581-41aad515cdfd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] Calling method '.version_select at 0x7f34ef577ca0>' {{(pid=119264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 17:28:11.532492 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: INFO nova.api.openstack.requestlog [None req-685f66b5-f6a0-4b14-a581-41aad515cdfd tempest-TestShelveInstance-258778408 tempest-TestShelveInstance-258778408-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1236472072" status: 202 len: 0 microversion: 2.1 time: 0.102327 Oct 10 17:28:11.533083 dv-cinder-834540-2-iscsi devstack@n-api.service[119264]: [pid: 119264|app: 0|req: 574/1156] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Oct 10 17:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1236472072 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)